The model needs a runner
A separate program must load the model files and put their weights to work. This program is the model runner.
The runner contains the executable instructions that:
- Turn text into tokens
- Perform the model's calculations
- Sample the next token
- Add it to the input and repeat
- Turn the completed tokens back into text
The model files contain what the Oracle learned. The runner contains code that puts those learned patterns to work.