按年被提到
20142014 · 1 次2026
大模型与语言模型›序列模型与注意力机制·arXiv:1410.1090 · cs.CV

Explain Images with Multimodal Recurrent Neural Networks

Junhua Mao, Wei Xu, Yi Yang, Jiang Wang, Alan L. Yuille · 2014
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2014-11-18 · 最近 2015-02-02
2不同的人
2活跃月份
2讨论串
350被引(OpenAlex)
arXiv 摘要(候选层不写导读)

In this paper, we present a multimodal Recurrent Neural Network (m-RNN) model for generating novel sentence descriptions to explain the content of images. It directly models the probability distribution of generating a word given previous words and the image. Image descriptions are generated by sampling from this distribution. The model consists of two sub-networks: a deep recurrent neural network for sentences and a deep convolutional network for images. These two sub-networks interact with each other in a multimodal layer to form the whole m-RNN model. The effectiveness of our model is validated on three benchmark datasets (IAPR TC-12, Flickr 8K, and Flickr 30K). Our model outperforms the state-of-the-art generative method. In addition, the m-RNN model can be applied to retrieval tasks for retrieving images or sentences, and achieves significant performance improvement over the state-of-the-art methods which directly optimize the ranking objective function for retrieval.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论karpathy · 2014-11

“Hi all, I'm the author on the Stanford article, so I can answer any more detailed/technical questions. The article doesn't mention this, but closely related work I've only very recently become aware of (if anyone is interested) are additionally: From UofT: http://arxiv.org/pdf/1411.2539v1.pdf From Baidu/UCLA: http://arxiv.org/pdf/1410.1090v1.pdf From G…”

Researchers Announce Advance in Image-Recognition Software原评论 ↗
评论nl · 2015-02

“There's a difference between the kind of things you are referring to as "projects" and the kind of things Ng is referring to as "tech". A "project" is usually an application of existing technology done in an innovative way. It may well end up being the next Facebook, but it isn't something that usually requires breakthroughs in scientific fields. Ng's (…”

Andrew Ng on the state of deep learning at Baidu原评论 ↗