按年被提到
20152015 · 1 次2026
机器学习与深度学习›神经科学启发的 AI·arXiv:1511.00083 · q-bio.NC

Why Neurons Have Thousands of Synapses, A Theory of Sequence Memory in Neocortex

Jeff Hawkins, Subutai Ahmad · 2015
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2015-11-05 · 最近 2022-04-12
2不同的人
3活跃月份
3讨论串
408被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Neocortical neurons have thousands of excitatory synapses. It is a mystery how neurons integrate the input from so many synapses and what kind of large-scale network behavior this enables. It has been previously proposed that non-linear properties of dendrites enable neurons to recognize multiple patterns. In this paper we extend this idea by showing that a neuron with several thousand synapses arranged along active dendrites can learn to accurately and robustly recognize hundreds of unique patterns of cellular activity, even in the presence of large amounts of noise and pattern variation. We then propose a neuron model where some of the patterns recognized by a neuron lead to action potentials and define the classic receptive field of the neuron, whereas the majority of the patterns recognized by a neuron act as predictions by slightly depolarizing the neuron without immediately generating an action potential. We then present a network model based on neurons with these properties and show that the network learns a robust model of time-based sequences. Given the similarity of excitatory neurons throughout the neocortex and the importance of sequence memory in inference and behavior, we propose that this form of sequence memory is a universal property of neocortical tissue. We further propose that cellular layers in the neocortex implement variations of the same sequence memory algorithm to achieve different aspects of inference and behavior. The neuron and network models we introduce are robust over a wide range of parameters as long as the network uses a sparse distributed code of cellular activations. The sequence capacity of the network scales linearly with the number of synapses on each neuron. Thus neurons need thousands of synapses to learn the many temporal patterns in sensory stimuli and motor sequences.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论p1esk · 2019-06

“Look into capsules, also [1-3] can give you an idea of what can be explored. Evolving NNs [4] would probably benefit the most from NN primitives research. IMO, the best source of ideas for novel primitives is neocortex [5, 6]. [1] https://arxiv.org/abs/1904.03955 [2] https://arxiv.org/abs/1811.11168 [3] https://arxiv.org/abs/1905.02961 [4] https://www.na…”

Ask HN: New Neural Network Primitives?原评论 ↗
评论Mageek · 2022-04

“An HTM layer is one feedforward layer in a Heirarchical Temporal Memory network. See for example https://arxiv.org/abs/1511.00083 which trains one-layer HTM models. See for example https://timallanwheeler.com/blog/2022/01/09/hierarchical-temporal-memory-of-the-1000-brains-theory/ for a more approachable blog post about the same topic”

How to Pursue a Career in Brain-Based AI原评论 ↗
被提交为 story · 1 次