Loading slide

What Attention Means

  1. 01What Attention Means
  2. 02What attention is for
  3. 03Memory card
  4. 04Which word matters right now?
  5. 05It's just a weighted blend
  6. 06Looking, advertising, offering
  7. 07Catch your breath
  8. 08Watch it lean
  9. 09Take a breath
  10. 10All at once, not one at a time
  11. 11More than one kind of relevance
  12. 12Reinforce your understanding
  13. 13Question: Computing relevance
  14. 14Question: Why parallel matters
  15. 15Question: The distance problem, gone
  16. 16Quiz: answer
  17. 17What to carry out of this chapter
  18. 18Want to go deeper?
9 / 17
BackNext

Take a breath

That was the densest stretch of the module. If queries and keys and folders are swimming a little, that is completely normal. Let's set the machinery down and say what attention is in one breath, with no parts.

To understand a word, attention looks across the whole sentence, decides which other words matter to it right now, and blends those words in, heavily for the ones that matter, barely at all for the ones that don't. That is it. A word reaches out, weighs everything else, and pulls in what counts.

Everything else in this chapter is just how it decides what matters: each word holds up a want-ad, every other word wears a chest-card, and the matches between them set the weights. If you remember only the want-ad-meets-chest-card picture, you remember enough.

There is one more thing about attention that has nothing to do with meaning and everything to do with why it won. It is about speed, and it reaches all the way back to the graphics cards from the going-deeper module. That is next.

Citations