Keep the working notes

As the system processes the prompt, it creates intermediate numerical results.

Picture a mathematician solving a long problem. The final answer matters, but so do the values written beside each completed step.

For an eligible prefix, the serving system can temporarily keep those working results.

Those saved results form the prompt cache.