按年被提到
20202021 · 2 次2026
机器学习与深度学习›神经科学启发的 AI·arXiv:2009.08378 · q-bio.NC

Event-Based Backpropagation can compute Exact Gradients for Spiking Neural Networks

Timo C. Wunderlich, Christian Pehle · 2020
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2020-09-18 · 最近 2023-12-07
2不同的人
4活跃月份
4讨论串
128被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Spiking neural networks combine analog computation with event-based communication using discrete spikes. While the impressive advances of deep learning are enabled by training non-spiking artificial neural networks using the backpropagation algorithm, applying this algorithm to spiking networks was previously hindered by the existence of discrete spike events and discontinuities. For the first time, this work derives the backpropagation algorithm for a continuous-time spiking neural network and a general loss function by applying the adjoint method together with the proper partial derivative jumps, allowing for backpropagation through discrete spike events without approximations. This algorithm, EventProp, backpropagates errors at spike times in order to compute the exact gradient in an event-based, temporally and spatially sparse fashion. We use gradients computed via EventProp to train networks on the Yin-Yang and MNIST datasets using either a spike time or voltage based loss function and report competitive performance. Our work supports the rigorous study of gradient-based learning algorithms in spiking neural networks and provides insights toward their implementation in novel brain-inspired hardware.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论orbifold · 2021-02

“You can actually calculate exact gradients for spiking neurons using the adjoint method: https://arxiv.org/abs/2009.08378 (I'm the second author). In my PhD thesis I show how this can be extended to larger problems and more complicated and biologically plausible neuron models. I agree with the gist of your post though: Retrofitting back propagation (or th…”

Don't Mess with Backprop: Doubts about Biologically Plausible Deep Learning原评论 ↗
评论orbifold · 2023-12

“That you can't backpropagate is a common misconception. There is recent work (I am one of the co-authors), that derives a precise analog of the backpropagation algorithm in spiking neural networks (https://arxiv.org/abs/2009.08378). It computes exact gradients and requires only communication at spike times during the backward pass. The reason this works i…”

Brain-Inspired Efficient Pruning: Criticality in Spiking Neural Networks原评论 ↗
被提交为 story · 2 次