按年被提到
20262026 · 4 次2026
强化学习与智能体›大模型智能体·arXiv:2603.24621 · cs.AI

ARC-AGI-3: A New Challenge for Frontier Agentic Intelligence

ARC Prize Foundation · 2026
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 4 人首次 2026-03-30 · 最近 2026-08-12
4不同的人
2活跃月份
3讨论串
10被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We introduce ARC-AGI-3, an interactive benchmark for studying agentic intelligence through novel, abstract, turn-based environments in which agents must explore, infer goals, build internal models of environment dynamics, and plan effective action sequences without explicit instructions. Like its predecessors ARC-AGI-1 and 2, ARC-AGI-3 focuses entirely on evaluating fluid adaptive efficiency on novel tasks, while avoiding language and external knowledge. ARC-AGI-3 environments only leverage Core Knowledge priors and are difficulty-calibrated via extensive testing with human test-takers. Our testing shows humans can solve 100% of the environments, in contrast to frontier AI systems which, as of March 2026, score below 1%. In this paper, we present the benchmark design, its efficiency-based scoring framework grounded in human action baselines, and the methodology used to construct, validate, and calibrate the environments.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论root-parent · 2026-08

“>> To me, this is more or less what I would think "Artificial General Intelligence" is So then you need to explain ARC-AGI-3: https://arxiv.org/abs/2603.24621 "Our testing shows humans can solve 100% of the environments, in contrast to frontier AI systems which, as of March 2026, score below 1%." Back 1996, EQP automatically solved the Robbins conjectu…”

Tim Gowers: What sort of maths are LLMs good at?原评论 ↗
评论scronkfinkle · 2026-08

“> So then you need to explain ARC-AGI-3: https://arxiv.org/abs/2603.24621 I don't, we originally had the turing test which was designed to determine human intelligence by its ability to imitate us with natural dialogue, but we've since defeated that. I stated "to me" because it's my personal opinion on a definition whose goalpost will probably never stop…”

Tim Gowers: What sort of maths are LLMs good at?原评论 ↗
被提交为 story · 2 次