Backpropagation - More than Chain Rule

Pre-requisites:

  1. Knowing multi-variable differentiation;
  2. It is recommended that readers have known the concepts of directed graphs.

This is my lecture note of the natural language processing (NLP) lecture in ETH Zurich. Lecturer: Ryan Cotterell. This lecture tells you what backpropagation algorithm really is.

Well, I have to say that it is surprising that backpropagation (BP) is taught in an NLP course instead of a machine learning course.

To view this article, please download:
Lecture_note1_BP.pdf

If I have time, I will implement BP with Python without PyTorch.

本文作者： lucainiaoge
本文链接： https://lucainiaoge.github.io.git/2021/10/04/Back_propagation/
版权声明： 本作品采用 Creative Commons authorship - noncommercial use - same way sharing 4.0 international license agreement 进行许可。转载请注明出处！
知识共享许可协议
Welcome to my little world
赏

Thx!!

扫一扫，分享到微信

微信分享二维码
{%if post.updated and post.updated > post.date%}   |   {{ __('post.updated') }} {% endif %}
# PV方式，单个用户连续点击 n 篇，记录 n 次记录值 total visit times # UV方式，单个用户连续点击 n 篇，记录 1 次记录值 number of visit in this site times
loading date...loading time stamp... | You are visitor

tag:

    缺失模块。
    1、请确保node版本大于6.2
    2、在博客根目录（注意不是yilia根目录）执行以下命令：
    npm i hexo-generator-json-content --save

    3、在根目录_config.yml里添加配置： 

      jsonContent:
    meta: false
    pages: false
    posts:
      title: true
      date: true
      path: true
      text: false
      raw: false
      content: false
      slug: false
      updated: false
      comments: false
      link: false
      permalink: false
      excerpt: false
      categories: false
      tags: true

lutongyucn@foxmail.com<br>Like composing. Like math.<br>Always learning.<br>-------------<br>路菜鸟一只<br>学习，写曲子，做白日梦<br>QQ:1248883052<br>wechat:lucainiao<br>Netease music:Innocent_Mr_Y