Hosted and local

A hosted conversation splits the parts across two places:

  • The village: Elara, the Scribe, and the ledger
  • The road: a Courier carrying a copied scroll
  • The mountain: the runner, Translator, and Oracle

A local conversation brings the mountain's working parts into the village:

The village: Elara, Scribe, ledger, copied scroll, runner, Translator, and Oracle

In the real system, the same distinction is simpler:

  • Hosted: chat app on your computer, model runner and model on the provider's servers
  • Local: chat app, model runner, and model on your computer

Local does not make the model the whole application. It moves the model and its surrounding software onto your machine.