The transcript can be cached too

Prompt caching is often introduced with long fixed instructions or documents.

But a chat transcript can also become part of the reusable prefix. Earlier user messages and assistant replies are ordinary input tokens when the application sends them again.

If they remain in the same order, their processing can be reused too.

The cache can cover history, not just instructions.