按年被提到
20232024 · 3 次2026
大模型与语言模型›大模型评测与真实性·arXiv:2308.16175 · cs.CL

Quantifying Uncertainty in Answers from any Language Model and Enhancing their Trustworthiness

Jiuhai Chen, Jonas Mueller · 2023
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 3 人首次 2023-09-05 · 最近 2024-08-28
3不同的人
2活跃月份
4讨论串
55被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We introduce BSDetector, a method for detecting bad and speculative answers from a pretrained Large Language Model by estimating a numeric confidence score for any output it generated. Our uncertainty quantification technique works for any LLM accessible only via a black-box API, whose training data remains unknown. By expending a bit of extra computation, users of any LLM API can now get the same response as they would ordinarily, as well as a confidence estimate that cautions when not to trust this response. Experiments on both closed and open-form Question-Answer benchmarks reveal that BSDetector more accurately identifies incorrect LLM responses than alternative uncertainty estimation procedures (for both GPT-3 and ChatGPT). By sampling multiple responses from the LLM and considering the one with the highest confidence score, we can additionally obtain more accurate responses from the same LLM, without any extra training steps. In applications involving automated evaluation with LLMs, accounting for our confidence scores leads to more reliable evaluation in both human-in-the-loop and fully-automated settings (across both GPT 3.5 and 4).

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论viraptor · 2024-08

“> LLMs aren't like that, they don't really know what they do know. They actually do. The information is saved there, you just need to ask explicitly, because the usual response doesn't expose it. (But likely can be fine tuned to do that) https://ar5iv.labs.arxiv.org/html/2308.16175 Also the original claim was that they're not capable of responding with …”

Does Reasoning Emerge? Probabilities of Causation in Large Language Models原评论 ↗
评论viraptor · 2024-08

“LLMs encode their certainty enough to output it again. They don't need to be specifically trained for this. https://ar5iv.labs.arxiv.org/html/2308.16175”

Anthropic publishes the 'system prompts' that make Claude tick原评论 ↗
被提交为 story · 2 次