Do neural networks think like brains?

No, and the comparison is worth taking apart rather than dismissing, because the places where it fails are more interesting than the places where it holds. The word "neural" is a historical accident that has been doing public-relations work for seventy years.

Background concept

Where the resemblance came from

The original 1943 model was an explicit simplification of a neuron: inputs arrive, get weighted, and if the total passes a threshold the unit fires. That was a reasonable sketch of what was known about neurons at the time, and it is roughly where the resemblance stops.

What real neurons do that artificial ones do not

What does hold up

Three things, and they are not nothing. Both systems compute with many simple units in parallel rather than one complicated sequential one. Both store what they know in connection strengths rather than in addressable memory. Both degrade gracefully: damage a few units and performance drops a little rather than failing outright.

Those are real structural parallels, and they are why the networks work at all. They are not evidence that the mechanisms are the same.

The version in this project, which is closer in one specific way

The organisms here are unusual among artificial networks in that nobody trains them by backpropagation. Their weights are inherited, mutated and filtered by whether their carriers leave descendants - which is, mechanically, how brains came to be the way they are.

Some of them also change during their own lifetime, by a local rule that only uses information available at the connection itself. That is far closer to what a synapse could plausibly implement than backpropagation is.

So this world gets closer on how the weights came to be, and remains just as far away on spikes, chemistry and structural growth. A fair summary: evolution and local learning are the two parts of the brain story that artificial networks usually skip, and this project runs both while skipping everything else.

What a neural network actually is · Evolution against learning, measured separately · Open one and look

References and further reading

Primary sources for the claims on this page. Where this project's own results are referred to, they link to the page carrying the evidence instead.

  1. McCulloch, W. S., & Pitts, W. (1943). A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics, 5, 115-133. doi:10.1007/BF02478259
  2. Crick, F. (1989). The recent excitement about neural networks. Nature, 337, 129-132. doi:10.1038/337129a0
  3. Lillicrap, T. P., Santoro, A., Marris, L., Akerman, C. J., & Hinton, G. (2020). Backpropagation and the brain. Nature Reviews Neuroscience, 21, 335-346. doi:10.1038/s41583-020-0277-3
  4. Elman, J. L. (1990). Finding Structure in Time. Cognitive Science, 14(2), 179-211. doi:10.1207/s15516709cog1402_1