Loading slide

The Context Window

  1. 01The Context Window
  2. 02Memory card
  3. 03What the model sees
  4. 04Fill it up
  5. 05What gets cut
  6. 06No memory between chats
  7. 07Take a breath
  8. 08Reinforce your understanding
  9. 09Question: What fits in the window
  10. 10Question: The illusion of memory
  11. 11Quiz: answer
  12. 12The window is the world
  13. 13Want to go deeper?
4 / 12
BackNext

Fill it up

Here is the board itself. The system prompt is pinned at the top, and each time you press send a message, a new turn drops onto the stack below it.

Keep pressing. For a while the board has room and every turn stays put. Then it fills. From that point on, every new message you add pushes the oldest one off the top. It does not shrink, it does not get summarised, it is simply gone: the model will not see it on the next reply.

Watch what slides off. Early on you told it "keep answers short." A few turns later that instruction is over the edge, and the model has no way to know it was ever there.

Citations
Citations