按年被提到
20212022 · 3 次2026
机器学习与深度学习›科学机器学习·arXiv:2108.00275 · cond-mat.dis-nn

Demonstration of Decentralized, Physics-Driven Learning

Sam Dillavou, Menachem Stern, Andrea J. Liu, Douglas J. Durian · 2021
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 3 人首次 2022-03-22 · 最近 2022-06-02
3不同的人
2活跃月份
2讨论串
88被引(OpenAlex)
arXiv 摘要(候选层不写导读)

In typical artificial neural networks, neurons adjust according to global calculations of a central processor, but in the brain neurons and synapses self-adjust based on local information. Contrastive learning algorithms have recently been proposed to train physical systems, such as fluidic, mechanical, or electrical networks, to perform machine learning tasks from local evolution rules. However, to date such systems have only been implemented in silico due to the engineering challenge of creating elements that autonomously evolve based on their own response to two sets of global boundary conditions. Here we introduce and implement a physics-driven contrastive learning scheme for a network of variable resistors, using circuitry to locally compare the response of two identical networks subjected to the two different sets of boundary conditions. Using this innovation, our system effectively trains itself, optimizing its resistance values without use of a central processor or external information storage. Once the system is trained for a specified allostery, regression, or classification task, the task is subsequently performed rapidly and automatically by the physical imperative to minimize power dissipation in response to the given voltage inputs. We demonstrate that, unlike typical computers, such learning systems are robust to extreme damage (and thus manufacturing defects) due to their decentralized learning. Our twin-network approach is therefore readily scalable to extremely large or nonlinear networks where its distributed nature will be an enormous advantage; a laboratory network of only 500 edges will already outpace its in silico counterpart.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论RaisinLoaf69 · 2022-03

“I actually work on this project! Feel free to ask any questions. Also, here’s an arxiv link to one of the papers if anyone is interested: https://arxiv.org/abs/2108.00275”

Simple electrical circuit learns on its own–with no help from a computer原评论 ↗
评论YeGoblynQueenne · 2022-03

“You are right of course that it shouldn't, but in practice it always is. The pragmatic reason for that is that if a team spends a month and a few thousand dollars developing and tuning a system, and then they find that the first time they test it on their held-out test set it doesn't work, there is no way that they'll just drop it and accept that all the…”

Simple electrical circuit learns on its own–with no help from a computer原评论 ↗
被提交为 story · 1 次