按年被提到
20182018 · 1 次2026
大模型与语言模型›检索增强与知识库·arXiv:1801.10198 · cs.CL

Generating Wikipedia by Summarizing Long Sequences

Peter J. Liu, Mohammad Saleh, Etienne Pot, Ben Goodrich, Ryan Sepassi, Lukasz Kaiser, Noam Shazeer · 2018
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2018-02-02 · 最近 2020-01-29
2不同的人
2活跃月份
2讨论串
578被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We show that generating English Wikipedia articles can be approached as a multi- document summarization of source documents. We use extractive summarization to coarsely identify salient information and a neural abstractive model to generate the article. For the abstractive model, we introduce a decoder-only architecture that can scalably attend to very long sequences, much longer than typical encoder- decoder architectures used in sequence transduction. We show that this model can generate fluent, coherent multi-sentence paragraphs and even whole Wikipedia articles. When given reference documents, we show it can extract relevant factual information as reflected in perplexity, ROUGE scores and human evaluations.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论nl · 2020-01

“There's active work on this (although in two separate strands of research). The first is multi-document summarization. Back in 2018 Google published Generating Wikipedia by Summarizing Long Sequences[1] which did a great job of combining multiple pages into a single Wikipedia-like document. Models have strengthened a lot since then so it should be possib…”

Towards a conversational agent that can chat about anything原评论 ↗
被提交为 story · 1 次