Loading slide

The server receives it

Tom’s request arrives at one of the provider’s servers.

on the server checks where the request should go. It then sends the request towards an available computer that can create the reply.

If all the suitable computers are busy, the request waits briefly in line. This waiting line is called a queue.

The request has reached the provider, but Tom’s words have not been processed yet.

# citations(2)↓
  1. [1]huggingface.co
  2. [2]huggingface.co

Loading contents...

[███░░░░░░░░░░░░░░░][████░░░░░░░░░░░░░░░░░░░░░░░░]5 / 35
<back>next