按年被提到
20232023 · 4 次2026
大模型与语言模型›大模型推理与思维链·arXiv:2302.00923 · cs.CL

Multimodal Chain-of-Thought Reasoning in Language Models

Zhuosheng Zhang, Aston Zhang, Mu Li, Hai Zhao, George Karypis, Alex Smola · 2023
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 3 人首次 2023-02-04 · 最近 2023-03-15
3不同的人
2活跃月份
4讨论串
324被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Large language models (LLMs) have shown impressive performance on complex reasoning by leveraging chain-of-thought (CoT) prompting to generate intermediate reasoning chains as the rationale to infer the answer. However, existing CoT studies have primarily focused on the language modality. We propose Multimodal-CoT that incorporates language (text) and vision (images) modalities into a two-stage framework that separates rationale generation and answer inference. In this way, answer inference can leverage better generated rationales that are based on multimodal information. Experimental results on ScienceQA and A-OKVQA benchmark datasets show the effectiveness of our proposed approach. With Multimodal-CoT, our model under 1 billion parameters achieves state-of-the-art performance on the ScienceQA benchmark. Our analysis indicates that Multimodal-CoT offers the advantages of mitigating hallucination and enhancing convergence speed. Code is publicly available at https://github.com/amazon-science/mm-cot.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论txtai · 2023-02

“InstructGPT which is a "sibling" model to ChatGPT is 1.3B parameters. https://openai.com/blog/instruction-following/ Another thread on HN (https://news.ycombinator.com/item?id=34653075) discusses a model that is less than 1B parameters and outperforms GPT-3.5. https://arxiv.org/abs/2302.00923 These models will get smaller and more efficiently use the p…”

Open Assistant – project meant to give everyone access to a great chat based LLM原评论 ↗
评论naasking · 2023-03

“Another one that looks even more compelling: Multimodal Chain-of-Thought Reasoning in Language Models, https://arxiv.org/abs/2302.00923 By building in chain of thought and multimodal learning, this 1B parameter model beats GPT-3.5's 170B parameter model.”

Microsoft Kosmos-1: A Multimodal Large Language Model原评论 ↗
评论naasking · 2023-03

“> It’s clear they do seem to construct models from which to derive responses. The problem is once you stray away from purely textual content, those models often get completely batshit I think you mean that it can only intelligently converse in domains for which it's seen training data. Obviously the corpus of natural language it was trained on does not g…”

被提交为 story · 1 次