“A killer paper presenting an algorithm capable of inductive learning.”
DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning
通过写程序学习,并自建领域语言的程序归纳系统
提出 DreamCoder,一个通过写程序来解决问题的系统:它为领域概念创建编程语言,并训练神经网络引导在这些语言中的程序搜索。唤醒-睡眠算法交替进行:一边用新的符号抽象扩展语言,一边在想象和回放的问题上训练神经网络。它能解决经典归纳编程任务以及画图、搭场景等创造性任务,并重新发现函数式编程基础、向量代数和牛顿定律、库仑定律。
评论者把它当作神经符号方法和程序归纳的里程碑:在 LLM 之前就展示了可组合、可解释的抽象学习,常被拿来对比后来的神经程序合成。
学习路径
读这篇之前,按顺序读书架上的 2 篇 · 参考文献来自 OpenAlex,顺序和要点由 Claude Code 排出候选里只有两篇和 DreamCoder 的核心思路直接相关:一篇讲类人学习为何需要组合性与程序式表示,一篇讲神经引导的程序搜索。
- 1
DreamCoder 的动机来自这里:类人学习靠组合性、因果模型和可复用概念。
读读组合性(compositionality)与「学会学习」的论述,理解为何要学一套领域概念语言。
- 2
DreamCoder 的识别网络沿用了神经网络引导程序搜索的思路。
读抓住用网络预测程序成分来缩小搜索空间的想法,以及基于输入输出示例的程序合成设定。
- 3DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning
把程序合成、神经引导搜索与自建语言(库学习)合到唤醒-睡眠框架里。
读抓 wake-sleep 的三个阶段:搜索程序、抽象出新概念扩充语言、用梦境数据训练识别网络。
HN 书评
推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及“the Dreamcoder paper in the paperswithcode search you linked to was an interesting milestone [2].”
“I liked the work on DreamCoder, particularly the part where it learned to draw in Logo graphics.”
“DreamCoder: DreamCoder is the latest development along this investigatory and very much underexplored path to Machine intelligence.”
“Reminds me of some recent neurosymbolic work, like "DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning" [1]”
“Another example from June 2020:”
看全部 13 条 →
“I know of at least one approach to neural program synthesis that employs self supervised learning.”
“LISP-without-macros in Dreamcoder”
“for example DreamCoder”
“I am personally interested in LLM's, MuZero ([OTHER_PAPER]), Dreamer ([OTHER_PAPER]) and DreamCoder”
“That's relevant for pursuing current neuro-symbolic research, e.g. DreamCoder.”
“We have, it's called DreamCoder. There's a paper and everything.”
“seems to periodically be rediscovered [2,3,4] in different contexts”
- DreamCoder: Growing generalizable, interpretable knowledge with program learning ↗bmc7505 · 2020-06-23 · 4 分
- DreamCoder, a system that learns to solve problems by writing programs ↗coolvision · 2021-02-06 · 3 分
- DreamCoder: Growing Generalizable, Interpretable Knowledge ↗fbodz · 2023-12-26 · 83 分