Loading slide

What a Trained Model Actually Is

  1. 01What a Trained Model Actually Is
  2. 02Memory card
  3. 03A model is a file
  4. 04Two files
  5. 05How the two fit together
  6. 06A Piano
  7. 07The valuable file
  8. 08You connect to it
  9. 09Where does training data come from?
  10. 10Cleaning the data
  11. 11The network can't read
  12. 12Guess the next word
  13. 13Right or wrong
  14. 14One nudge, a billion times
  15. 15Take a breath
  16. 16Where your memories live
  17. 17A base model is not an assistant
  18. 18Why it's called pre-training
  19. 19The weights are the model
  20. 20The scale of it
  21. 21Why so many?
  22. 22What a weight actually is
  23. 23Everywhere and nowhere
  24. 24Using the model: inference
  25. 25The whole arrangement
  26. 26Reinforce your understanding
  27. 27Question: What is a model, really?
  28. 28Question: Learning from raw text
  29. 29Question: The model doesn't know what it doesn't know
  30. 30Quiz: answer
  31. 31The machine learned something real.
  32. 32Want to go deeper?
23 / 31
BackNext

Everywhere and nowhere

We met this idea once already, with the brain: no single neuron holds your grandmother, the memory is spread across the connections. A model works the same way. No single weight holds "Tokyo is the capital of Japan." The fact is smeared across billions of them, each contributing a sliver to countless different outputs.

That sounds like a quirk. It is actually the source of the model's most important power.

A spreadsheet can only give back what was typed into it. Ask it about a city nobody entered, and it has nothing. A model is different. Because it stored a pattern rather than a list of facts, it can answer about things it was never explicitly taught. It learned the shape of how capitals, countries, and language relate, and that shape stretches to fill gaps it never saw during training.

This is generalization, the idea from an earlier chapter: handling examples it was never trained on, like the student who understood the material instead of memorizing the practice exam. Back then we saw that it happens. Now we can see why. Because the knowledge lives in a pattern and not a list, the model has something to stretch. It is not looking up answers. It is extending a pattern.

The same property has an uncomfortable flip side. If no fact lives in one place, no fact can simply be looked up, corrected, or deleted. You cannot open the file and fix the line about Tokyo, because there is no line. And when the pattern stretches too far, the model will extend it confidently into an answer that is just wrong. The same machinery that lets it answer new questions is what lets it make things up. We will come back to that.

Citations(2)↓
  1. 1. deeplearningbook.org
  2. 2. arxiv.org
Citations(2)↓
  1. 1. deeplearningbook.org
  2. 2. arxiv.org