按年被提到
20222023 · 1 次2026
大模型与语言模型›大模型推理与思维链·arXiv:2205.10625 · cs.AI

Least-to-Most Prompting Enables Complex Reasoning in Large Language Models

Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Claire Cui, Olivier Bousquet, Quoc Le, Ed Chi · 2022
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2023-04-18 · 最近 2024-10-23
2不同的人
2活跃月份
2讨论串
824被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Chain-of-thought prompting has demonstrated remarkable performance on various natural language reasoning tasks. However, it tends to perform poorly on tasks which requires solving problems harder than the exemplars shown in the prompts. To overcome this challenge of easy-to-hard generalization, we propose a novel prompting strategy, least-to-most prompting. The key idea in this strategy is to break down a complex problem into a series of simpler subproblems and then solve them in sequence. Solving each subproblem is facilitated by the answers to previously solved subproblems. Our experimental results on tasks related to symbolic manipulation, compositional generalization, and math reasoning reveal that least-to-most prompting is capable of generalizing to more difficult problems than those seen in the prompts. A notable finding is that when the GPT-3 code-davinci-002 model is used with least-to-most prompting, it can solve the compositional generalization benchmark SCAN in any split (including length split) with an accuracy of at least 99% using just 14 exemplars, compared to only 16% accuracy with chain-of-thought prompting. This is particularly noteworthy because neural-symbolic models in the literature that specialize in solving SCAN are trained on the entire training set containing over 15,000 examples. We have included prompts for all the tasks in the Appendix.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论ninetyninenine · 2024-10

“I have. The failure is with you and your extracting only the mechanical functionality of LLMs as all an LLM is. The high level macro structure of what ends up being trained is something nobody understands. Regardless of WHAT I say, the general consensus among academia and professionals is extremely different from what you characterize. I can cite dozens…”

LLMs Aren't Thinking, They're Just Counting Votes原评论 ↗
被提交为 story · 1 次