按年被提到
20142015 · 1 次2026
大模型与语言模型›序列模型与注意力机制·arXiv:1410.8206 · cs.CL

Addressing the Rare Word Problem in Neural Machine Translation

Minh-Thang Luong, Ilya Sutskever, Quoc V. Le, Oriol Vinyals, Wojciech Zaremba · 2014
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2015-01-15 · 最近 2016-05-17
2不同的人
2活跃月份
2讨论串
101被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Neural Machine Translation (NMT) is a new approach to machine translation that has shown promising results that are comparable to traditional approaches. A significant weakness in conventional NMT systems is their inability to correctly translate very rare words: end-to-end NMTs tend to have relatively small vocabularies with a single unk symbol that represents every possible out-of-vocabulary (OOV) word. In this paper, we propose and implement an effective technique to address this problem. We train an NMT system on data that is augmented by the output of a word alignment algorithm, allowing the NMT system to emit, for each OOV word in the target sentence, the position of its corresponding word in the source sentence. This information is later utilized in a post-processing step that translates every OOV word using a dictionary. Our experiments on the WMT14 English to French translation task show that this method provides a substantial improvement of up to 2.8 BLEU points over an equivalent NMT system that does not use this technique. With 37.5 BLEU points, our NMT system is the first to surpass the best result achieved on a WMT14 contest task.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论ogrisel · 2015-01

“New neural machine translation architectures are experimenting with pairs of neural encoders / decoders, one pair for each language and a shared language independent vector space for the meaning of all words: http://arxiv.org/abs/1406.1078 http://arxiv.org/abs/1409.3215 http://arxiv.org/abs/1410.8206 So the total number of models is still linear with …”

New, more powerful Google Translate app原评论 ↗
评论jkrause314 · 2016-05

“Clickbait. This is a patent on a very particular form of translation model that handles rare words, i.e. this paper that all the authors are on: http://arxiv.org/abs/1410.8206”

Google applying to patent deep neural network (LSTM) for machine translation原评论 ↗