The model needs a runner

A separate program must load the model files and put their weights to work. This program is the model runner.

The runner contains the executable instructions that:

  • Turn text into tokens
  • Perform the model's calculations
  • Sample the next token
  • Add it to the input and repeat
  • Turn the completed tokens back into text

The model files contain what the Oracle learned. The runner contains code that puts those learned patterns to work.