按年被提到
20162016 · 2 次2026
大模型与语言模型›词向量与预训练模型·arXiv:1607.04606 · cs.CL

Enriching Word Vectors with Subword Information

Piotr Bojanowski, Edouard Grave, Armand Joulin, Tomas Mikolov · 2016
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 3 人首次 2016-08-04 · 最近 2017-07-04
3不同的人
2活跃月份
3讨论串
457被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Continuous word representations, trained on large unlabeled corpora are useful for many natural language processing tasks. Popular models that learn such representations ignore the morphology of words, by assigning a distinct vector to each word. This is a limitation, especially for languages with large vocabularies and many rare words. In this paper, we propose a new approach based on the skipgram model, where each word is represented as a bag of character $n$-grams. A vector representation is associated to each character $n$-gram; words being represented as the sum of these representations. Our method is fast, allowing to train models on large corpora quickly and allows us to compute word representations for words that did not appear in the training data. We evaluate our word representations on nine different languages, both on word similarity and analogy tasks. By comparing to recently proposed morphological word representations, we show that our vectors achieve state-of-the-art performance on these tasks.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论kough · 2016-08

“Links to the relevant papers: Bag of Tricks for Efficient Text Classification: https://arxiv.org/abs/1607.01759v2 Enriching Word Vectors with Subword Information: https://arxiv.org/abs/1607.04606 Both fantastic papers. For those who aren't aware, Mikolov also helped create word2vec. One curious thing: this seems to use heirarchal softmax instead of th…”

FastText – Library for fast text representation and classification原评论 ↗
评论minimaxir · 2016-08

“This was posted in 2015, but now that fasttext (https://github.com/facebookresearch/fastText), just released by Facebook and can scale to Instagram-sized datasets, can create word vectors better than word2vec which account for context (https://arxiv.org/pdf/1607.04606v1.pdf), this type of analysis will only improve in the future.”

Machine Learning for Emoji Trends原评论 ↗
被提交为 story · 1 次