Carry one contrast forward.

An arbitrary ID identifies a word but says nothing useful about its neighbours. A learned representation can place words used in similar ways near one another, so distance begins to carry information.

Before the model can learn those positions, it needs a fixed set of text pieces to represent. Whole words are not the only option. The next chapter breaks text into reusable pieces called tokens.