按年被提到
20252025 · 1 次2026
大模型与语言模型›大模型文本、写作与版权·arXiv:2510.08831 · cs.AI

The human-authorship halo: attribution bias in literary style evaluation by humans and AI

Wouter Haverals, Meredith Martin · 2025
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2025-10-19 · 最近 2026-02-16
2不同的人
2活跃月份
2讨论串
3被引(OpenAlex)
arXiv 摘要(候选层不写导读)

As AI writing tools become widespread, we need to understand how both humans and machines evaluate literary style, a domain where objective standards are elusive and judgments are inherently subjective. We conducted controlled experiments using Raymond Queneau's Exercises in Style (1947) to measure attribution bias across evaluators. Study 1 compared human participants (N=556) and AI models (N=13) evaluating literary passages from Queneau versus GPT-4-generated versions under three conditions: blind, accurately labeled, and counterfactually labeled. Study 2 tested bias generalization across a 14x14 matrix of AI evaluators and creators. Both studies revealed systematic pro-human attribution bias. Humans showed +13.7 percentage point (pp) bias (Cohen's h = 0.28, 95% CI: 0.19-0.37), while AI models showed +34.3 percentage point bias (h = 0.70, 95% CI: 0.62-0.78), a 2.5-fold stronger effect (P<0.001). Study 2 confirmed this bias operates across AI architectures (+25.8pp, 95% CI: 24.1-27.6%), demonstrating that AI systems systematically devalue creative content when labeled as "AI-generated" regardless of which AI created it. We also find that attribution labels lead evaluators to invert assessment criteria, with identical features receiving opposing evaluations based solely on perceived authorship. This suggests AI models have absorbed human cultural biases against artificial creativity during training, including through the preference signals on which they are aligned. Our study represents the first controlled comparison of attribution bias between human and artificial evaluators in aesthetic judgment, revealing that AI systems not only replicate but amplify this human tendency.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论Der_Einzige · 2026-02

“FWIW: When I accuse folks of it, take it more seriously - we literally wrote a paper (ICLR 2026) on deslopping language models: https://arxiv.org/abs/2510.15061 Also you might not care, but normies sure care! https://arxiv.org/html/2410.03723v2 https://arxiv.org/html/2510.08831v1”

I guess I kinda get why people hate AI原评论 ↗
被提交为 story · 1 次