The moving boundary

The boundary between old and new moves to the right.

Question B is fresh when it first arrives. After the model answers, both question B and answer B can appear unchanged in the next request.

The cache does not freeze the conversation at one moment.

It can follow an append-only sequence as that sequence grows.