按年被提到
20242024 · 3 次2026
大模型与语言模型›检索增强与知识库·arXiv:2401.05749 · cs.CL

A Shocking Amount of the Web is Machine Translated: Insights from Multi-Way Parallelism

Brian Thompson, Mehak Preet Dhaliwal, Peter Frisch, Tobias Domhan, Marcello Federico · 2024
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 4 人首次 2024-01-14 · 最近 2025-12-10
4不同的人
2活跃月份
3讨论串
41被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We show that content on the web is often translated into many languages, and the low quality of these multi-way translations indicates they were likely created using Machine Translation (MT). Multi-way parallel, machine generated content not only dominates the translations in lower resource languages; it also constitutes a large fraction of the total web content in those languages. We also find evidence of a selection bias in the type of content which is translated into many languages, consistent with low quality English content being translated en masse into many lower resource languages, via MT. Our work raises serious concerns about training models such as multilingual large language models on both monolingual and bilingual data scraped from the web.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论orbital-decay · 2024-01

“The study they refer to [1] seems to be about machine-translated versions of human-written pages (that exist on a large scale for a ~decade already). The article somehow blows it out of proportion, it's not like most of what you're reading is generated by the current crop of large transformers. [1] https://arxiv.org/pdf/2401.05749.pdf”

Huge proportion of internet is AI-generated slime, researchers find原评论 ↗
评论chacham15 · 2024-01

“The title is clickbait. The actual study[0] reads as follows: > Multi-way parallel, machine generated content not only dominates the translations in lower resource languages; it also constitutes a large fraction of the total web content in those languages This is talking specifically about text being translated into less common languages being done most…”

Huge proportion of internet is AI-generated slime, researchers find原评论 ↗
评论red-iron-pine · 2025-12

“easily 30-40%. you could see trends even as far back as 2020. same patterns as with reddit. e.g. bunch of old accounts with random bursts of activity, often posting to old / stale threads (e.g. 2-3 days old, when no one is looking at them), and often saying generic one liners or regurgitating summarizations of top / most upvoted points. except when the …”

A.I. Videos Have Flooded Social Media. No One Was Ready原评论 ↗
被提交为 story · 1 次