Compaction rewrites the past

A conversation may eventually become too long. An application can replace older turns with a shorter summary. This is often called compaction.

Compaction saves space, but it rewrites the beginning of the request.

The summary may preserve the meaning of the old conversation. It does not preserve the old token sequence.

Compaction can therefore break a large cached prefix.