Loading slide

What the Cold Taught Us

  1. 01What the Cold Taught Us
  2. 02What failure teaches
  3. 03The assumptions that broke
  4. 04The problem with logic
  5. 05Knowledge is not rules
  6. 06The quiet work
  7. 07Connectionism returns
  8. 08Why the winters mattered
  9. 09Reinforce your understanding
  10. 10Question: assumptions
  11. 11Question: connectionism
  12. 12Question: legacy
  13. 13Quiz: answer
  14. 14The thaw
  15. 15Want to go deeper?
7 / 14
BackNext

Connectionism returns

This approach was called connectionism. Instead of writing rules for a machine to follow, you built a network of connected units that could adjust their connections based on what worked and what didn't. Show it enough examples, let it correct itself, and over time it learned.

It had failed before, or at least been declared a dead end. In 1969, Minsky and a colleague published a book showing real limitations of early neural networks, and most of the field took it as a verdict. But the researchers who stayed found ways around those limits.

In 1986, the researcher and colleagues published a technique for training deeper, more capable networks in a way that actually worked. They called it backpropagation: a method for telling each part of the network how much it contributed to a wrong answer, so it could adjust. The payoff was still decades away. But the direction had changed.

Citations(2)↓
  1. 1. nature.com
  2. 2. mitpress.mit.edu