Loading slide

Loading contents...

[████████░░░░░░░░░░][████████████░░░░░░░░░░░░░░░░]14 / 33
<back>next

The biological inspiration

The idea of unequal connections did not come from nowhere. In the brain, connections between neurons can differ in how strongly they influence the next cell.

A biological neuron usually receives signals through branches called . Those signals spread into the .

If the combined activity reaches a threshold, the neuron sends an electrical pulse along its .

That pulse is the same size every time. A strong signal does not produce a bigger pulse than a weak one, which is why the pulse is often described as all-or-nothing. So how does a brain cell say strongly rather than slightly?

It fires faster. A cell that has a little to report might send a few pulses a second. A cell that has a lot to report can send over a hundred. The strength is carried by the rate, not by the size of any single pulse.

That is worth holding onto, because it is easy to hear "each pulse is all-or-nothing" and conclude that brain cells only ever say yes or no. Counted over any stretch of time, a firing rate is a smooth quantity, not a switch. Some cells in the eye skip the pulses entirely and pass their signal onward as a continuously varying level.

The match is not exact. A biological neuron does not multiply neat decimal values like the artificial neuron in the umbrella example, and it works in time, sending a stream of pulses rather than settling on one figure.

The artificial version borrows only the broad pattern: many inputs, unequal influence, one combined result, and one signal passed onward.

# citations(4)↓
  1. [1]ncbi.nlm.nih.gov
  2. [2]ncbi.nlm.nih.gov
  3. [3]ncbi.nlm.nih.gov
  4. [4]ncbi.nlm.nih.gov