Loading slide

What a Trained Model Actually Is

  1. 01What a Trained Model Actually Is
  2. 02Memory card
  3. 03A model is a file
  4. 04Two files
  5. 05How the two fit together
  6. 06A Piano
  7. 07The valuable file
  8. 08You connect to it
  9. 09Where does training data come from?
  10. 10Cleaning the data
  11. 11The network can't read
  12. 12Guess the next word
  13. 13Right or wrong
  14. 14One nudge, a billion times
  15. 15Take a breath
  16. 16Where your memories live
  17. 17A base model is not an assistant
  18. 18Why it's called pre-training
  19. 19The weights are the model
  20. 20The scale of it
  21. 21Why so many?
  22. 22What a weight actually is
  23. 23Everywhere and nowhere
  24. 24Using the model: inference
  25. 25The whole arrangement
  26. 26Reinforce your understanding
  27. 27Question: What is a model, really?
  28. 28Question: Learning from raw text
  29. 29Question: The model doesn't know what it doesn't know
  30. 30Quiz: answer
  31. 31The machine learned something real.
  32. 32Want to go deeper?
17 / 31
BackNext

A base model is not an assistant

So the knowledge is in there, spread across the weights. The natural question is what it lets the model actually do. And the answer, at this stage, is narrower than you might expect.

After training on that ocean of internet text, the model has become very good at one specific thing: continuing text.

Show it the beginning of a Wikipedia article and it will write a plausible continuation. Show it the start of a news story and it will carry it forward. Show it a recipe and it will keep going.

This is called a base model. And a base model is not an assistant.

Ask it a question and it won't answer you. It will continue the text as if the question were the beginning of a document it had seen before. It might write more questions. It might write a quiz. It might write a forum thread with people debating the answer. It has no idea you wanted a direct response. The conversation on the right is what that actually looks like.

So the model knows an enormous amount and is still strangely unhelpful. Which raises an obvious question: how does it become the assistant you actually talk to?

Citations(2)↓
  1. 1. arxiv.org
  2. 2. openai.com
Citations(2)↓
  1. 1. arxiv.org
  2. 2. openai.com