Watch the network work

Press run input. The drawing shows the input moving through the model's layers.

Then press generate reply. Watch each new token join the context before the next token is produced.

This is a simplified view of ordinary token-by-token generation. It shows the dependency between output steps, not a measurement of hardware speed.

A short invitation and a long report may begin with the same notes. The report still requires more output steps.

Press run input. The drawing shows the input moving through the model's layers.

Then press generate reply. Watch each new token join the context before the next token is produced.

This is a simplified view of ordinary token-by-token generation. It shows the dependency between output steps, not a measurement of hardware speed.

A short invitation and a long report may begin with the same notes. The report still requires more output steps.