Context is still there
The cached prefix remains part of the model's context.
Caching changes how the serving system processes that beginning. It does not remove the tokens from the request or make them stop counting toward the model's context limit.
A suitcase packed faster still contains the same clothes.
Prompt caching saves repeated calculation, not context space.
# citations