按年被提到
20172017 · 2 次2026
大模型与语言模型›词向量与预训练模型·arXiv:1712.09405 · cs.CL

Advances in Pre-Training Distributed Word Representations

Tomas Mikolov, Edouard Grave, Piotr Bojanowski, Christian Puhrsch, Armand Joulin · 2017
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 3 人首次 2017-12-29 · 最近 2019-02-25
3不同的人
2活跃月份
3讨论串
962被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Many Natural Language Processing applications nowadays rely on pre-trained word representations estimated from large text corpora such as news collections, Wikipedia and Web Crawl. In this paper, we show how to train high-quality word vector representations by using a combination of known tricks that are however rarely used together. The main result of our work is the new set of publicly available pre-trained models that outperform the current state of the art by a large margin on a number of tasks.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论gwern · 2019-02

“Nope, the paper says it's just using the FastText word embedding: https://nips2018creativity.github.io/doc/entendrepreneur.pdf which is just a particularly well-done word2vec: https://arxiv.org/pdf/1712.09405.pdf 'Lasker' and 'chess' no doubt co-occur quite strongly in their Internet corpus.”

Portmanteau Generator原评论 ↗
被提交为 story · 2 次