按年被提到
20182018 · 1 次2026
大模型与语言模型›长上下文与测试时计算·arXiv:1804.04849 · cs.NE

The unreasonable effectiveness of the forget gate

Jos van der Westhuizen, Joan Lasenby · 2018
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2018-04-16 · 最近 2019-03-20
2不同的人
2活跃月份
2讨论串
68被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Given the success of the gated recurrent unit, a natural question is whether all the gates of the long short-term memory (LSTM) network are necessary. Previous research has shown that the forget gate is one of the most important gates in the LSTM. Here we show that a forget-gate-only version of the LSTM with chrono-initialized biases, not only provides computational savings but outperforms the standard LSTM on multiple benchmark datasets and competes with some of the best contemporary models. Our proposed network, the JANET, achieves accuracies of 99% and 92.5% on the MNIST and pMNIST datasets, outperforming the standard LSTM which yields accuracies of 98.5% and 91%.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

没有评论直接链到它;下面是它被提交的讨论串里回复最多的评论(不计入统计)

讨论串里没有 ≥100 字的评论,只有提交记录。

被提交为 story · 2 次