What the cache stores
The cache is not a saved answer.
It holds working results produced while the model processed the matching prefix. These are numbers inside the serving system, not a human-readable summary of the conversation.
The exact details vary between model systems.
The durable idea is simple: keep completed calculation, not completed conversation.
# citations