Why Shallow Networks Failed

  1. 01Why Shallow Networks Failed
  2. 02The vanishing gradient
  3. 03The activation function problem
  4. 04Don't worry about the name
  5. 05Other fixes
  6. 06Depth vs. width
  7. 07The research gap
  8. 08Reinforce your understanding
  9. 09Question: The vanishing gradient
  10. 10Question: Why does a simple fix work?
  11. 11Question: Why does depth matter?
  12. 12Quiz: answer
  13. 13The gradient problem was solved. What was still missing was scale.
  14. 14Want to go deeper?
Backskip quiz