Loading slide

ImageNet and the Turning Point

  1. 01ImageNet and the Turning Point
  2. 02Fei-Fei Li and ImageNet
  3. 03The traditional approach
  4. 04AlexNet
  5. 05What it felt like
  6. 06What made it work
  7. 07How it taught itself
  8. 08Take a breath
  9. 09What did it actually learn?
  10. 10The field responds
  11. 11Why this was a hinge
  12. 12Memory card
  13. 13Reinforce your understanding
  14. 14Question: Data vs. algorithm
  15. 15Question: Hand-engineered vs. learned features
  16. 16Question: What does a turning point feel like from inside?
  17. 17Quiz: answer
  18. 18What you now know
  19. 19The machine could now see. The next question was whether it could read.
  20. 20Want to go deeper?
11 / 19
BackNext

Why this was a hinge

Some improvements move a needle. Some move the goalposts.

ImageNet 2012 moved the goalposts. It settled a question that had been contested for years: whether machines could learn useful features on their own, without humans deciding what to look for. Before 2012, many researchers doubted it. After AlexNet, the debate was over.

It also gave the field something concrete to build on. Not an abstract claim, but a specific network, with specific techniques, that anyone could train and verify for themselves.

Everything that followed, the voice recognition in your phone, the image generators, the language models, the AI assistants, traces back to what AlexNet proved. Not because AlexNet itself was used in all of them, but because it showed the approach worked.

The bet a small group had kept alive for two decades had paid off. And it carried a lesson the field would lean on for the next ten years: the way forward was not a cleverer idea, but more. More layers, more data, more compute. The emergence we glimpsed in the last chapter, new abilities appearing from scale, became the bet the field kept making.

This was the moment the AI era began.

Citations(2)↓
  1. 1. papers.nips.cc
  2. 2. arxiv.org
Citations(2)↓
  1. 1. papers.nips.cc
  2. 2. arxiv.org