“but the paper is still a good read), especially [1]”
Efficient Estimation of Word Representations in Vector Space
提出 word2vec,几乎不费算力就能学出高质量词向量
论文提出两种新的模型架构,用于从非常大的数据集中计算词的连续向量表示。在词相似度任务上,它们以低得多的计算成本取得大幅精度提升:在 16 亿词的数据集上不到一天就能学到高质量词向量,并在衡量句法和语义相似度的测试集上达到当时最好的表现。
HN 上的人把它当作词向量和 embedding 的起点来推荐,称无需 NLP 或神经网络背景也读得懂,并常以「king 减 man 加 woman」的向量类比来说明它的影响。
HN 书评
推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及“And the paper itelf is a very worthwhile read: Efficient Estimation of Word Representations in Vector Space”
“The paper associated with word2vec is fairly easy to read and understand, even if you don't have a background in NLP or neural networks: Efficient Estimation of Word Representations in Vector Space”
“Word2Vec kind of exploded everyone's mind for a while.”
“Mikolov, et al. 2013 [1] do a proper evaluation of this.”
“Word2vec is exciting because it has a useable amount of accuracy for a relatively small amount of cleverness on the part of the human.”
看全部 16 条 →
“the key two approaches to read up on would probably be Mikolov's word2vec”
“The recent emergent semantic vector algebra discovered in human languages by Mikolov's word2vec”
“Mikolov's[3] Word2vec & Radford's Image Vectors[4] produce semantic spaces where vector math is akin to reasoning.”
“The other widely reported vector algebras in a semantic space were discovered by Mikolov et al when producing ~300 dimensional vectors for a billion word Wikipedia corpus.”
“if you have some kind of embedding of your words/tokens/sentences/something you cite Efficient Estimation of Word Representations in Vector Space (Word2Vec, Mikolov).”
“what I could grasp from the wikipedia article [0] and the original paper [1] is that word2vec uses a vector to represent words in a n-dimensional space.”
“akin to how Mikolov et al. reconsidered how to learn vector representations back in 2013 [3]”
“Here’s a paper about the technique which might help: Efficient Estimation of Word Representations in Vector Space”
“And the original word2vec paper by Mikolov mentions it Efficient Estimation of Word Representations in Vector Space”
“a bit of discussion about this in the Word2Vec paper[1]”
- Efficient Estimation of Word Representations in Vector Space (2013) ↗baristaGeek · 2017-01-10 · 3 分