按年被提到
20232023 · 11 次2026
大模型与语言模型›大模型推理与思维链·arXiv:2305.10601 · cs.CL

Tree of Thoughts: Deliberate Problem Solving with Large Language Models

思维树:用大语言模型进行审慎的问题求解
Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, Karthik Narasimhan · 2023

让 LLM 在思维树上搜索、回溯与自评以解题

开始阅读 ↗PDFalphaXiv 讨论
被推荐 · 14 人首次 2023-05-19 · 最近 2026-03-16
14不同的人
7活跃月份
13讨论串
1,733被引(OpenAlex)

提出思维树(Tree of Thoughts,ToT)推理框架,推广了思维链提示:让语言模型在作为中间步骤的连贯文本单元(thoughts)上做探索,考虑多条推理路径并自我评估,必要时前瞻或回溯以做全局选择。在需要规划或搜索的三个新任务(24 点、创意写作、迷你填字)上显著提升表现,例如 24 点任务上,GPT-4 用思维链只解出 4%,ToT 达到 74%。

HN 为什么提它

评论者把它当作比链式思维更精细的推理时搜索方法,用来讨论 LLM 如何回溯、规划以及在推理时投入更多计算。

方法难度 3 / 5约 40 分钟经得起时间
读之前最好知道
1思维链提示(chain-of-thought)
2树搜索与广度/深度优先搜索
3大语言模型提示工程
4推理时计算(test-time compute)

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
推荐superbiome · 2023-05

“There’s also an interesting paper about providing it guidance that it can make a “tree of thoughts””

提到一篇有意思的论文:给模型引导,让它构建“思维树”
Ask HN: Those with success using GPT-4 for programming – what are you doing?原评论 ↗
推荐lucubratory · 2023-06

“you should definitely give it a read: Tree of Thoughts”

强烈推荐读:Tree of Thoughts 是接近规划的审慎 LLM 搜索概念
LLM Powered Autonomous Agents原评论 ↗
推荐segmondy · 2024-09

“TreeOfThoughts is a more sophisticated method, see - Tree of Thoughts”

指出 Tree of Thoughts 是比思维链循环更复杂的方法
g1: Using Llama-3.1 70B on Groq to create o1-like reasoning chains原评论 ↗
引用flakiness · 2023-05

“The research itself [1] seems legit.”

认为这项研究看起来靠谱:在推理步骤上做审慎搜索
Tree of Thoughts原评论 ↗
引用joshka · 2023-05

“Interestingly a 2 days prior to Tree of Thoughts, someone released [OTHER_PAPER]”

指出在它发表前两天有人发了一篇类似的数独求解论文
Tree of Thoughts原评论 ↗
引用eterevsky · 2023-06

“with some high-level iterative/recursive process like this: Tree of Thoughts.”

引用它作为迭代式 LLM 搜索的例子,类似这样的高层迭代/递归流程
Moderation strike: Stack Overflow Inc cannot ignore, mistreat, malign volunteers原评论 ↗
看全部 11 条 →
引用krychu · 2023-07

“Tree of thoughts: Tree of Thoughts”

列出 Tree of Thoughts 的来源论文
Langchain Is Pointless原评论 ↗
引用heliophobicdude · 2023-07

“If it is like Tree of Thoughts [1]”

希望 Gemini 的做法像 Tree of Thoughts 这种审慎的问题求解方法
Bard’s latest update: more features, languages and countries原评论 ↗
引用richardw · 2023-11

“On backtracking, I thought tree-of-thought enabled that?”

反问回溯不是 tree-of-thought 已经能做到的吗
Sam Altman's ouster was precipitated by letter to board about AI breakthrough原评论 ↗
引用ninetyninenine · 2024-10

“I can cite dozens of research papers contrary to your point in a simple google search:”

引用它作为反例,反驳对方“LLM 只是统计投票”的观点
LLMs Aren't Thinking, They're Just Counting Votes原评论 ↗
引用at2005 · 2026-03

“but the original ToT paper has a section on it: Tree of Thoughts”

指出原始 ToT 论文里有一节讨论 MCTS 式搜索作为测试时算力
Tree Search Distillation for Language Models Using PPO原评论 ↗
被提交为 story · 3 次