按年被提到
20232023 · 1 次2026
大模型与语言模型›对话式大模型·arXiv:2311.16989 · cs.CL

ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?

Hailin Chen, Fangkai Jiao, Xingxuan Li, Chengwei Qin, Mathieu Ravaut, Ruochen Zhao, Caiming Xiong, Shafiq Joty · 2023
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2023-12-01 · 最近 2024-02-03
2不同的人
2活跃月份
2讨论串
40被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning from human feedback, it showed that a model could answer human questions and follow instructions on a broad panel of tasks. Following this success, interests in LLMs have intensified, with new LLMs flourishing at frequent interval across academia and industry, including many start-ups focused on LLMs. While closed-source LLMs (e.g., OpenAI's GPT, Anthropic's Claude) generally outperform their open-source counterparts, the progress on the latter has been rapid with claims of achieving parity or even better on certain tasks. This has crucial implications not only on research but also on business. In this work, on the first anniversary of ChatGPT, we provide an exhaustive overview of this success, surveying all tasks where an open-source LLM has claimed to be on par or better than ChatGPT.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

没有评论直接链到它;下面是它被提交的讨论串里回复最多的评论(不计入统计)
讨论串评论refibrillator · 2023-12

“It's not mentioned in the paper but OpenChat 3.5 released the first 7b model that achieves results comparable to ChatGPT in March 2023 [1]. Only 8k context window, but personally I've been very impressed with it so far. In many ways open source LLMs are actually leading the industry in terms of parameter efficiency and shipping useful models that consume…”

ChatGPT's 1-Year Anniversary: Are Open-Source Large Language Models Catching Up?原评论 ↗
讨论串评论lhl · 2023-12

“A couple big/strong open models that have just been released the past few days: * Qwen 72B (and 1.8B) - 32K context, trained on 3T tokens, <100M MAU commercial license, strong benchmark performance: https://twitter.com/huybery/status/1730127387109781932 * DeepSeek LLM 67B - 4K context, 2T tokens, Apache 2.0 license, strong on code (although DeepSeek Cod…”

ChatGPT's 1-Year Anniversary: Are Open-Source Large Language Models Catching Up?原评论 ↗
讨论串评论fintechie · 2023-12

“We're nearing a point where we'll just need a prompt router in front of several specialised models (code, chat, math, sql, health, etc)... and we'll have a local Mixture of Experts kind of thing. 1. Send request to router running a generic model. 2. Prompt/question is deconstructed, classified, and proxied to expert(s) xyz. 3. Responses come back and a…”

ChatGPT's 1-Year Anniversary: Are Open-Source Large Language Models Catching Up?原评论 ↗
被提交为 story · 2 次