按年被提到
20232023 · 1 次2026
大模型与语言模型›对话式大模型·arXiv:2305.15047 · cs.CL

Ghostbuster: Detecting Text Ghostwritten by Large Language Models

Vivek Verma, Eve Fleisig, Nicholas Tomlin, Dan Klein · 2023
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2023-11-15 · 最近 2024-05-16
2不同的人
2活跃月份
2讨论串
16被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We introduce Ghostbuster, a state-of-the-art system for detecting AI-generated text. Our method works by passing documents through a series of weaker language models, running a structured search over possible combinations of their features, and then training a classifier on the selected features to predict whether documents are AI-generated. Crucially, Ghostbuster does not require access to token probabilities from the target model, making it useful for detecting text generated by black-box models or unknown model versions. In conjunction with our model, we release three new datasets of human- and AI-generated text as detection benchmarks in the domains of student essays, creative writing, and news articles. We compare Ghostbuster to a variety of existing detectors, including DetectGPT and GPTZero, as well as a new RoBERTa baseline. Ghostbuster achieves 99.0 F1 when evaluated across domains, which is 5.9 F1 higher than the best preexisting model. It also outperforms all previous approaches in generalization across writing domains (+7.5 F1), prompting strategies (+2.1 F1), and language models (+4.4 F1). We also analyze the robustness of our system to a variety of perturbations and paraphrasing attacks and evaluate its performance on documents written by non-native English speakers.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论nequo · 2024-05

“If this is not a joke, it might actually be a viable idea. It works pretty well for English text, for example: https://arxiv.org/abs/2305.15047”

NetBSD bans all commits of AI-generated code原评论 ↗
被提交为 story · 1 次