A growing conversation repeats much of the same input on every turn.

Prompt caching recognizes an exact matching beginning and reuses working results kept by the serving system. New material still needs new work. Change an earlier token, and the old match stops at that point.

The conversation still travels with the request. The model still remembers nothing.

The system has simply kept the work already done.