按年被提到
20202024 · 2 次2026
机器学习与深度学习›神经科学启发的 AI·arXiv:2006.04439 · cs.LG

Liquid Time-constant Networks

Ramin Hasani, Mathias Lechner, Alexander Amini, Daniela Rus, Radu Grosu · 2020
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2024-08-17 · 最近 2024-09-30
2不同的人
2活跃月份
2讨论串
29被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We introduce a new class of time-continuous recurrent neural network models. Instead of declaring a learning system's dynamics by implicit nonlinearities, we construct networks of linear first-order dynamical systems modulated via nonlinear interlinked gates. The resulting models represent dynamical systems with varying (i.e., liquid) time-constants coupled to their hidden state, with outputs being computed by numerical differential equation solvers. These neural networks exhibit stable and bounded behavior, yield superior expressivity within the family of neural ordinary differential equations, and give rise to improved performance on time-series prediction tasks. To demonstrate these properties, we first take a theoretical approach to find bounds over their dynamics and compute their expressive power by the trajectory length measure in latent trajectory space. We then conduct a series of time-series prediction experiments to manifest the approximation capability of Liquid Time-Constant Networks (LTCs) compared to classical and modern RNNs. Code and data are available at https://github.com/raminmh/liquid_time_constant_networks

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论programjames · 2024-09

“The ideas come from these papers: 1. [Liquid Time-Constant Networks (2020)](https://arxiv.org/abs/2006.04439) This is essentially a neural ODE applied to leaky integrate-and-fire. 2. [Closed-form Continuous-time (2022)](https://arxiv.org/abs/2106.13898) A closed-form approximation of the first.”

Liquid Foundation Models: Our First Series of Generative AI Models原评论 ↗
被提交为 story · 1 次