按年被提到
20242024 · 1 次2026
AI 安全、伦理与社会影响›通用智能与意识·arXiv:2404.07227 · cs.AI

Is Complexity an Illusion?

Michael Timothy Bennett · 2024
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2024-06-03 · 最近 2026-10-21
2不同的人
2活跃月份
2讨论串
13被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Simplicity is held by many to be the key to general intelligence. Simpler models tend to "generalise", identifying the cause or generator of data with greater sample efficiency. The implications of the correlation between simplicity and generalisation extend far beyond computer science, addressing questions of physics and even biology. Yet simplicity is a property of form, while generalisation is of function. In interactive settings, any correlation between the two depends on interpretation. In theory there could be no correlation and yet in practice, there is. Previous theoretical work showed generalisation to be a consequence of "weak" constraints implied by function, not form. Experiments demonstrated choosing weak constraints over simple forms yielded a 110-500% improvement in generalisation rate. Here we show that all constraints can take equally simple forms, regardless of weakness. However if forms are spatially extended, then function is represented using a finite subset of forms. If function is represented using a finite subset of forms, then we can force a correlation between simplicity and generalisation by making weak constraints take simple forms. If function is determined by a goal directed process that favours versatility (e.g. natural selection), then efficiency demands weak constraints take simple forms. Complexity has no causal influence on generalisation, but appears to due to confounding.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

没有评论直接链到它;下面是它被提交的讨论串里回复最多的评论(不计入统计)
讨论串评论SillyUsername · 2024-06

“I've always believed this. Complexity is just a state of partial ignorance of detail. Once a concept is fully understood it is no longer complex. Unfortunately there are barriers to understanding: Technical (our current technology is limited and cannot yet describe what is being considered past the theoretical). Social (people don't want to understan…”

Is Complexity an Illusion?原评论 ↗
被提交为 story · 2 次