按年被提到
20152015 · 1 次2026
大模型与语言模型›词向量与预训练模型·arXiv:1511.06388 · cs.CL

sense2vec - A Fast and Accurate Method for Word Sense Disambiguation In Neural Word Embeddings

Andrew Trask, Phil Michalak, John Liu · 2015
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2015-11-23 · 最近 2017-06-12
2不同的人
2活跃月份
2讨论串
134被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Neural word representations have proven useful in Natural Language Processing (NLP) tasks due to their ability to efficiently model complex semantic and syntactic word relationships. However, most techniques model only one representation per word, despite the fact that a single word can have multiple meanings or "senses". Some techniques model words by using multiple vectors that are clustered based on context. However, recent neural approaches rarely focus on the application to a consuming NLP algorithm. Furthermore, the training process of recent word-sense models is expensive relative to single-sense embedding processes. This paper presents a novel approach which addresses these concerns by modeling multiple embeddings for each word based on supervised disambiguation, which provides a fast and accurate way for a consuming NLP model to select a sense-disambiguated embedding. We demonstrate that these embeddings can disambiguate both contrastive senses such as nominal and verbal senses as well as nuanced senses such as sarcasm. We further evaluate Part-of-Speech disambiguated embeddings on neural dependency parsing, yielding a greater than 8% average error reduction in unlabeled attachment scores across 6 languages.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论nl · 2017-06

“This demo uses the Spacy POS tagging to build a word embedding which disambiguates multiple senses. The paper explains it: https://arxiv.org/abs/1511.06388”

Word Embeddings: Past, Present, and Future原评论 ↗
被提交为 story · 1 次