按年被提到
20192019 · 2 次2026
大模型与语言模型›序列模型与注意力机制·arXiv:1901.11504 · cs.CL

Multi-Task Deep Neural Networks for Natural Language Understanding

Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao · 2019
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 3 人首次 2019-02-16 · 最近 2024-09-17
3不同的人
2活跃月份
3讨论串
1,216被引(OpenAlex)
arXiv 摘要(候选层不写导读)

In this paper, we present a Multi-Task Deep Neural Network (MT-DNN) for learning representations across multiple natural language understanding (NLU) tasks. MT-DNN not only leverages large amounts of cross-task data, but also benefits from a regularization effect that leads to more general representations in order to adapt to new tasks and domains. MT-DNN extends the model proposed in Liu et al. (2015) by incorporating a pre-trained bidirectional transformer language model, known as BERT (Devlin et al., 2018). MT-DNN obtains new state-of-the-art results on ten NLU tasks, including SNLI, SciTail, and eight out of nine GLUE tasks, pushing the GLUE benchmark to 82.7% (2.2% absolute improvement). We also demonstrate using the SNLI and SciTail datasets that the representations learned by MT-DNN allow domain adaptation with substantially fewer in-domain labels than the pre-trained BERT representations. The code and pre-trained models are publicly available at https://github.com/namisan/mt-dnn.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论yorwba · 2019-02

“The paper has been on arXiv for a while already. https://arxiv.org/abs/1901.11504 Maybe Microsoft doesn't feel like making a big splash about their research?”

Microsoft’s New MT-DNN Outperforms Google BERT原评论 ↗
评论alephnerd · 2024-09

“> Care to give some examples In the 2010s they were the leader in NLP and the precursor of LLMs like GPT3/3.5/4/4o Machine Translation with Human Parity (2018) - https://arxiv.org/abs/1803.05567 MT-DNN (2019) - https://arxiv.org/abs/1901.11504 MASS (2019) - https://arxiv.org/abs/1905.02450 VALL-E (2023) - https://arxiv.org/abs/2301.02111 VALL-E 2 (2…”

Amazon's Secret Weapon in Chip Design Is Amazon原评论 ↗
被提交为 story · 1 次