按年被提到
20162017 · 2 次2026
大模型与语言模型›序列模型与注意力机制·arXiv:1611.02344 · cs.CL

A Convolutional Encoder Model for Neural Machine Translation

Jonas Gehring, Michael Auli, David Grangier, Yann N. Dauphin · 2016
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2017-04-10 · 最近 2017-05-10
2不同的人
2活跃月份
2讨论串
52被引(OpenAlex)
arXiv 摘要(候选层不写导读)

The prevalent approach to neural machine translation relies on bi-directional LSTMs to encode the source sentence. In this paper we present a faster and simpler architecture based on a succession of convolutional layers. This allows to encode the entire source sentence simultaneously compared to recurrent networks for which computation is constrained by temporal dependencies. On WMT'16 English-Romanian translation we achieve competitive accuracy to the state-of-the-art and we outperform several recently published results on the WMT'15 English-German task. Our models obtain almost the same accuracy as a very deep LSTM setup on WMT'14 English-French translation. Our convolutional encoder speeds up CPU decoding by more than two times at the same or higher accuracy as a strong bi-directional LSTM baseline.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论jhj · 2017-04

“ConvNets can handle sequences just as well (cf. TDNNs), you just treat time as another dimension. Whether you want to call this a "frame" or not is subject to question. https://arxiv.org/pdf/1611.02344.pdf With an explicit (potentially arbitrarily large) memory component, they can also capture long-term dependencies that don't have to be maintained in, …”

Stanford Brainstorm Chip to Hints at Neuromorphic Computing Future原评论 ↗
评论jgehring · 2017-05

“Yes, there have been a couple of attempts to use CNNs for translation already, but none of them outperformed big and well-tuned LSTM systems. We propose an architecture that is fast to run, easy to optimize and can scale to big networks, and could thus be used as a base architecture for future research. There are a couple of contributions in the paper (h…”

A novel approach to neural machine translation原评论 ↗