Loading slide
Take a moment with something strange. Think of your grandmother's face. Or the smell of rain. Or how to ride a bike. Now ask: where, exactly, is that stored?
It feels like there should be an answer. A folder in your head labelled "grandmother." A file you open. But there isn't. Your brain has no hard drive, no shelf, no single cell holding the memory. If a surgeon went looking, they would never find the spot where "grandmother" lives, because there is no spot.
Your brain is roughly 86 billion neurons, tiny cells, each one connected to thousands of others. A neuron on its own knows nothing. What matters is the connections between them, and how strong each connection is. Learning something does not write a file anywhere. It changes the strength of those connections. A memory, as best neuroscience can tell, is not a thing you store. It is a pattern: a particular set of neurons that fire together, in a particular way, because the connections between them were tuned by everything you have ever experienced.
This should sound familiar. It is exactly what we just watched happen to the model. The weights are its connections. Training tuned their strengths, one tiny nudge at a time, until knowledge lived in the pattern rather than in any single number. Nobody can point to the weight where "the sky is full of stars" is stored, for the same reason a surgeon cannot point to your grandmother. The knowledge is spread across the whole.
The analogy only goes so far. A real neuron is vastly more complex than a number, and the brain almost certainly does not learn the way a model does. But the deepest idea holds in both: understanding is not kept somewhere. It emerges from connections, tuned by experience, distributed across the whole.
Did you know?