按年被提到
20242024 · 2 次2026
大模型与语言模型›大模型推理与思维链·arXiv:2408.00114 · cs.AI

Inductive or Deductive? Rethinking the Fundamental Reasoning Abilities of LLMs

Kewei Cheng, Jingfeng Yang, Haoming Jiang, Zhengyang Wang, Binxuan Huang, Ruirui Li, Shiyang Li, Zheng Li, Yifan Gao, Xian Li, Bing Yin, Yizhou Sun · 2024
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2024-08-17 · 最近 2024-09-02
2不同的人
2活跃月份
2讨论串
13被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Reasoning encompasses two typical types: deductive reasoning and inductive reasoning. Despite extensive research into the reasoning capabilities of Large Language Models (LLMs), most studies have failed to rigorously differentiate between inductive and deductive reasoning, leading to a blending of the two. This raises an essential question: In LLM reasoning, which poses a greater challenge - deductive or inductive reasoning? While the deductive reasoning capabilities of LLMs, (i.e. their capacity to follow instructions in reasoning tasks), have received considerable attention, their abilities in true inductive reasoning remain largely unexplored. To investigate into the true inductive reasoning capabilities of LLMs, we propose a novel framework, SolverLearner. This framework enables LLMs to learn the underlying function (i.e., $y = f_w(x)$), that maps input data points $(x)$ to their corresponding output values $(y)$, using only in-context examples. By focusing on inductive reasoning and separating it from LLM-based deductive reasoning, we can isolate and investigate inductive reasoning of LLMs in its pure form via SolverLearner. Our observations reveal that LLMs demonstrate remarkable inductive reasoning capabilities through SolverLearner, achieving near-perfect performance with ACC of 1 in most cases. Surprisingly, despite their strong inductive reasoning abilities, LLMs tend to relatively lack deductive reasoning capabilities, particularly in tasks involving ``counterfactual'' reasoning.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

没有评论直接链到它;下面是它被提交的讨论串里回复最多的评论(不计入统计)
讨论串评论hydrox24 · 2024-09

“Is there a good reason to exclude abductive reasoning from an analysis like this? It's even considered by at least one of the referenced papers (Fangzhi 2023a). Abductive reasoning is common in day-to-day life. It seeks the best explanation for some (often incomplete) observations, and reaches conclusions without certainty. I would have thought it would …”

Inductive or deductive? Rethinking the fundamental reasoning abilities of LLMs原评论 ↗
讨论串评论AdieuToLogic · 2024-09

“Large Language Model algorithms do not reason. They are statistical text generators, whose results are defined by their training data set. This is why the paper cited reads thusly: Despite extensive research into the reasoning capabilities of Large Language Models (LLMs), most studies have failed to rigorously differentiate between inductive and deducti…”

Inductive or deductive? Rethinking the fundamental reasoning abilities of LLMs原评论 ↗
讨论串评论godelski · 2024-09

“I'm really tired of these papers and experiments. You cannot test reasoning when you don't know what's in the training set. You have to be able to differentiate reasoning from memorization, and that's not trivial. Moreso, the results look to confirm that at least some memorization is going on. Do we really not think GPT has extensively been trained on a…”

Inductive or deductive? Rethinking the fundamental reasoning abilities of LLMs原评论 ↗
被提交为 story · 2 次