按年被提到
20232023 · 3 次2026
大模型与语言模型›大模型文本、写作与版权·arXiv:2305.00118 · cs.CL

Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4

Kent K. Chang, Mackenzie Cramer, Sandeep Soni, David Bamman · 2023
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2023-05-04 · 最近 2023-06-01
2不同的人
2活跃月份
3讨论串
109被引(OpenAlex)
arXiv 摘要(候选层不写导读)

In this work, we carry out a data archaeology to infer books that are known to ChatGPT and GPT-4 using a name cloze membership inference query. We find that OpenAI models have memorized a wide collection of copyrighted materials, and that the degree of memorization is tied to the frequency with which passages of those books appear on the web. The ability of these models to memorize an unknown set of books complicates assessments of measurement validity for cultural analytics by contaminating test data; we show that models perform much better on memorized books than on non-memorized books for downstream tasks. We argue that this supports a case for open models whose training data is known.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论sanxiyn · 2023-05

“LLMs totally do, and the fact can be confirmed by experiment. See "Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4": https://arxiv.org/abs/2305.00118”

Please don’t upload my code on GitHub原评论 ↗
评论sanxiyn · 2023-06

“For detailed investigation of this phenomenon, see Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4: https://arxiv.org/abs/2305.00118”

Japan Goes All In: Copyright Doesn’t Apply to AI Training原评论 ↗
被提交为 story · 1 次