按年被提到
20252025 · 4 次2026
大模型与语言模型›提示工程与输出稳定性·arXiv:2507.16126 · cs.AI

TaxCalcBench: Evaluating Frontier Models on the Tax Calculation Task

Michael R. Bock, Kara Molisee, Zachary Ozer, Sumit Shah · 2025
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 4 人首次 2025-07-25 · 最近 2025-10-16
4不同的人
2活跃月份
4讨论串
2被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Can AI file your taxes? Not yet. Calculating US personal income taxes is a task that requires building an understanding of vast amounts of English text and using that knowledge to carefully compute results. We propose TaxCalcBench, a benchmark for determining models' abilities to calculate personal income tax returns given all of the necessary information. Our experiment shows that state-of-the-art models succeed in calculating less than a third of federal income tax returns even on this simplified sample set. Our analysis concludes that models consistently misuse tax tables, make errors in tax calculation, and incorrectly determine eligibility. Our findings point to the need for additional infrastructure to apply LLMs to the personal income tax calculation task.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论astrange · 2025-10

“Model training data already contains all the text there is[0], so they can already answer questions like this (especially with web search), but they aren't good at tax calculations. https://arxiv.org/abs/2507.16126v1 [0] but it's quite possible the conversion from HTML to text is bad”

IRS open sources its fact graph原评论 ↗
被提交为 story · 3 次