Loading slide

ImageNet and the Turning Point

  1. 01ImageNet and the Turning Point
  2. 02Fei-Fei Li and ImageNet
  3. 03The traditional approach
  4. 04AlexNet
  5. 05What it felt like
  6. 06What made it work
  7. 07How it taught itself
  8. 08Take a breath
  9. 09What did it actually learn?
  10. 10The field responds
  11. 11Why this was a hinge
  12. 12Memory card
  13. 13Reinforce your understanding
  14. 14Question: Data vs. algorithm
  15. 15Question: Hand-engineered vs. learned features
  16. 16Question: What does a turning point feel like from inside?
  17. 17Quiz: answer
  18. 18What you now know
  19. 19The machine could now see. The next question was whether it could read.
  20. 20Want to go deeper?

Module complete

Next: 06: The Meaning of Words

BackStart module 06

Deep learning had conquered vision. Show a network enough images, let it train long enough on GPU hardware, and it could recognize objects better than hand-crafted systems built by experts over decades.

The same techniques spread quickly. Speech recognition. Medical imaging. Drug discovery. The architecture was general enough to work across many domains.

Language was next. And language was harder.

An image is a grid of numbers, pixel brightnesses, each one a clean numerical value. A word is not a number. "Cat" and "dog" aren't close or far from each other the way numbers are. You can't just feed words into a neural network the same way you feed in pixels.

The next module is about that problem: how do you turn language into something a machine can actually work with?

Citations