按年被提到
20232023 · 1 次2026
大模型与语言模型›大模型推理与思维链·arXiv:2308.03762 · cs.CL

GPT-4 Can't Reason

Konstantine Arkoudas · 2023
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2023-11-18 · 最近 2024-07-12
2不同的人
2活跃月份
2讨论串
31被引(OpenAlex)
arXiv 摘要(候选层不写导读)

GPT-4 was released in March 2023 to wide acclaim, marking a very substantial improvement across the board over GPT-3.5 (OpenAI's previously best model, which had powered the initial release of ChatGPT). However, despite the genuinely impressive improvement, there are good reasons to be highly skeptical of GPT-4's ability to reason. This position paper discusses the nature of reasoning; criticizes the current formulation of reasoning problems in the NLP community, as well as the way in which LLM reasoning performance is currently evaluated; introduces a small collection of 21 diverse reasoning problems; and performs a detailed qualitative evaluation of GPT-4's performance on those problems. Based on this analysis, the paper concludes that, despite its occasional flashes of analytical brilliance, GPT-4 at present is utterly incapable of reasoning.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论cscurmudgeon · 2023-11

“Sorry. Robust research says no. Remember, people thought Eliza was AGI too. https://arxiv.org/abs/2308.03762 If it was really AGI, there won't even be ambiguity and room for comments like mine.”

Ilya Sutskever "at the center" of Altman firing原评论 ↗
评论armitron · 2024-07

“The "GPT-4 Can't Reason" paper [1] [2] is excellent and proves without a shadow of a doubt that there is no reasoning taking place. It also raises strong doubts about the efficacy and reliability of multi-agent approaches that rely on LLM-based planning (such as Cradle [3], which is currently on the front page). When it was previously discussed here, it …”

Reasoning skills of large language models are often overestimated原评论 ↗