“I'm not an expert in the field, but I've yet to see a solid rebuttal to this paper;”
Hallucination is Inevitable: An Innate Limitation of Large Language Models
用学习理论证明大模型的幻觉无法完全消除
论文把幻觉形式化为可计算的 LLM 与可计算的真值函数之间的不一致,并借助学习理论证明:LLM 无法学会所有可计算函数,因此作为通用问题求解器必然会产生幻觉。作者认为形式化世界只是真实世界的一部分,所以真实的 LLM 也不可避免地幻觉,并针对受可证明时间复杂度限制的真实 LLM 描述易幻觉的任务、做了实证验证,还讨论了现有幻觉缓解手段的机制与效果。
评论者每逢讨论幻觉就引用它作为「幻觉不可避免」的形式化证明,有人称还没见到有力的反驳,也有人坦言只读过标题。
HN 书评
推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及“But hallucinations are not avoidable either.”
“Here is a formal proof.”
“My understanding was the opposite -- that the activity of a confabulating LLM is indistinguishable from one giving factually accurate responses.”
“This seems like it's true since LLMs are a finite size”
“I can offer cite that hallucinations are an innate property of LLMs”
看全部 20 条 →
“What reinforces my opinion are papers like these: [OTHER_PAPER] Hallucination is Inevitable”
“some papers describe it [0] and [1] for example.”
“And researchers proven that: Hallucination is Inevitable”
“LLM will always hallucinate. People did already some research, among which: [OTHER_PAPER] and Hallucination is Inevitable for example.”
“(disclaimer, I also have not read any of these papers beyond the title!)”
“and yet, the paper that went around in March:”
“Every article on hallucinations needs to start with this fact until we've hammered that into every "AI Engineer"'s head.”
“Still, the whole idea of probabilistic selection of tokens more or less guarantees it'll go wrong from time to time. (See e.g. Hallucination is Inevitable)”
“We get study after study and example after example showing that AI is unreliable [1]”
“Hallucinations are, in fact, an unavoidable property of the technology - something which is not true for people. [0]”
“It's literally an unavoidable fact unless we change the modelling approach.”
“And some limitations are fundamental, and have been rigorously demonstrated, e.g.:”
“with their inherent and unsolvable[1] hallucination problems”
“I find hallucinations in my (mostly perfect) AI output every single day.”