The prompt prefix

A sequence that starts at the very beginning is called a prefix.

In the word garden, gar is a prefix. The letters den appear in the word, but they are not a prefix because they do not begin at the first letter.

A prompt prefix is the uninterrupted run of tokens from the start of a model request.

Prompt caching does not search for familiar scraps anywhere. It reuses a matching beginning.