按年被提到
20242024 · 1 次2026
AI 安全、伦理与社会影响›AI 的经济与社会影响·arXiv:2412.04604 · cs.AI

ARC Prize 2024: Technical Report

Francois Chollet, Mike Knoop, Gregory Kamradt, Bryan Landers · 2024
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2024-12-20 · 最近 2025-09-17
2不同的人
2活跃月份
2讨论串
43被引(OpenAlex)
arXiv 摘要(候选层不写导读)

As of December 2024, the ARC-AGI benchmark is five years old and remains unbeaten. We believe it is currently the most important unsolved AI benchmark in the world because it seeks to measure generalization on novel tasks -- the essence of intelligence -- as opposed to skill at tasks that can be prepared for in advance. This year, we launched ARC Prize, a global competition to inspire new ideas and drive open progress towards AGI by reaching a target benchmark score of 85\%. As a result, the state-of-the-art score on the ARC-AGI private evaluation set increased from 33\% to 55.5\%, propelled by several frontier AGI reasoning techniques including deep learning-guided program synthesis and test-time training. In this paper, we survey top approaches, review new open-source implementations, discuss the limitations of the ARC-AGI-1 dataset, and share key insights gained from the competition.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论throwaway71271 · 2024-12

“| Name | Semi-private eval | Public eval | |--------------------------------------|-------------------|-------------| | Jeremy Berman | 53.6% | 58.5% | | Akyürek et al. | 47.5% | 62.8% | | Ryan Greenblatt | 43% | 42% | | OpenAI o1-preview (pass@1) | 18% | 21% | | Anthropic Claude 3.5 Sonnet (pass@1) | 14% | 21% | | OpenAI GPT-4o (pass@1) | 5% | 9% | | Goo…”

OpenAI O3 breakthrough high score on ARC-AGI-PUB原评论 ↗
评论aymericzzz · 2025-09

“Hey HN, Aymeric here, co-founder of Agemo and maker of CodeWords. Generating nice-looking UIs with AI has been democratized now thanks to tools like Lovable, v0 and bolt. Going from natural language to a complex back-end workflow is still an unsolved problem. We started our journey by researching neurosymbolic methods applied to software/code generation…”

Show HN: CodeWords – Build automations by chatting with AI原评论 ↗