“Detecting LLM-generated text is basically solved by modern watermarking techniques (https://arxiv.org/abs/2306.09194). However, the main trouble with watermark-based approaches is that you have to get every LLM provider to adopt it. A student trying to cheat could always opt for some open-weight Chinese model, if the word spreads that the major providers …”
Undetectable Watermarks for Language Models
Recent advances in the capabilities of large language models such as GPT-4 have spurred increasing concern about our ability to detect AI-generated text. Prior works have suggested methods of embedding watermarks in model outputs, by noticeably altering the output distribution. We ask: Is it possible to introduce a watermark without incurring any detectable change to the output distribution? To this end we introduce a cryptographically-inspired notion of undetectable watermarks for language models. That is, watermarks can be detected only with the knowledge of a secret key; without the secret key, it is computationally intractable to distinguish watermarked outputs from those of the original model. In particular, it is impossible for a user to observe any degradation in the quality of the text. Crucially, watermarks should remain undetectable even when the user is allowed to adaptively query the model with arbitrarily chosen prompts. We construct undetectable watermarks based on the existence of one-way functions, a standard assumption in cryptography.
候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。
HN 书评
推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及- Undetectable Watermarks for Language Models ↗cryptohell · 2023-06-16 · 1 分
- Undetectable Watermarks for LLMs ↗cryptohell · 2023-06-17 · 1 分
- Undetectable Watermarks for Language Models ↗belter · 2023-06-17 · 2 分
- Undetectable Watermarks for LLMs ↗cryptohell · 2023-06-30 · 1 分