Less repeated computation

The main gain is less repeated work on the input.

If 9,000 tokens of a 10,000-token request match saved work, the serving system can reuse calculation for most of the request and focus fresh processing near the end.

That can reduce the time and computing work needed before generation reaches the new material.

The exact gain depends on the provider, model, prompt, and whether the cache is available.