按年被提到
20192019 · 1 次2026
大模型与语言模型›大模型预训练与缩放·arXiv:1902.04094 · cs.CL

BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model

Alex Wang, Kyunghyun Cho · 2019
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2019-02-21 · 最近 2025-10-20
2不同的人
2活跃月份
2讨论串
174被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We show that BERT (Devlin et al., 2018) is a Markov random field language model. This formulation gives way to a natural procedure to sample sentences from BERT. We generate from BERT and find that it can produce high-quality, fluent generations. Compared to the generations of a traditional left-to-right language model, BERT generates sentences that are more diverse but of slightly worse quality.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论thatguysaguy · 2025-10

“Back when BERT came out, everyone was trying to get it to generate text. These attempts generally didn't work, here's one for reference though: https://arxiv.org/abs/1902.04094 This doesn't have an explicit diffusion tie in, but Savinov et al. at DeepMind figured out that doing two steps at training time and randomizing the masking probability is enough …”

BERT is just a single text diffusion step原评论 ↗
被提交为 story · 1 次