The whole mechanism

One request creates working results for an eligible beginning.

A later request starts with the same tokens. The serving system finds the match, reuses those results, and performs fresh calculation after the boundary.

An early change shortens the match. Expiry can remove it. New output still has to be generated.

Prompt caching lets a repeated beginning keep the work already done.