What travels with the model?

The model package and the model runner provide different things.

The model package contains:

  • Learned weights
  • The model’s arrangement
  • Token vocabulary and rules
  • Suggested settings

The model runner contains:

  • Code that performs the calculations
  • Tokenizer functions
  • The sampler
  • The generation loop

The package supplies model-specific data. The runner supplies the executable instructions.