按年被提到
20242024 · 4 次2026
大模型与语言模型›大模型推理与思维链·arXiv:2402.03620 · cs.AI

Self-Discover: Large Language Models Self-Compose Reasoning Structures

Pei Zhou, Jay Pujara, Xiang Ren, Xinyun Chen, Heng-Tze Cheng, Quoc V. Le, Ed H. Chi, Denny Zhou, Swaroop Mishra, Huaixiu Steven Zheng · 2024
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 4 人首次 2024-02-07 · 最近 2024-05-21
4不同的人
2活跃月份
4讨论串
49被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We introduce SELF-DISCOVER, a general framework for LLMs to self-discover the task-intrinsic reasoning structures to tackle complex reasoning problems that are challenging for typical prompting methods. Core to the framework is a self-discovery process where LLMs select multiple atomic reasoning modules such as critical thinking and step-by-step thinking, and compose them into an explicit reasoning structure for LLMs to follow during decoding. SELF-DISCOVER substantially improves GPT-4 and PaLM 2's performance on challenging reasoning benchmarks such as BigBench-Hard, grounded agent reasoning, and MATH, by as much as 32% compared to Chain of Thought (CoT). Furthermore, SELF-DISCOVER outperforms inference-intensive methods such as CoT-Self-Consistency by more than 20%, while requiring 10-40x fewer inference compute. Finally, we show that the self-discovered reasoning structures are universally applicable across model families: from PaLM 2-L to GPT-4, and from GPT-4 to Llama2, and share commonalities with human reasoning patterns.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论glial · 2024-05

“I think LLMs will need to do what humans do: invent symbolic representations of systems and then "reason" by manipulating those systems according to rules. Here's a paper working along those lines: https://arxiv.org/abs/2402.03620”

ChatGPT-4o vs. Math原评论 ↗
评论sigmoid10 · 2024-05

“You'll have to check research publications if you want the latest stuff. The approach indicated in the comment you replied to is from this paper from February: https://arxiv.org/pdf/2402.03620 If you want the semi-latest stuff, you can also try various blogs, but they vary wildly in covered topics and quality.”

Trying out the panel-of-experts prompting strategy for LLMs原评论 ↗
被提交为 story · 2 次