按年被提到
20242024 · 2 次2026
大模型与语言模型›提示工程与输出稳定性·arXiv:2404.07503 · cs.CL

Best Practices and Lessons Learned on Synthetic Data

Ruibo Liu, Jerry Wei, Fangyu Liu, Chenglei Si, Yanzhe Zhang, Jinmeng Rao, Steven Zheng, Daiyi Peng, Diyi Yang, Denny Zhou, Andrew M. Dai · 2024
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2024-10-03 · 最近 2024-12-15
2不同的人
2活跃月份
2讨论串
118被引(OpenAlex)
arXiv 摘要(候选层不写导读)

The success of AI models relies on the availability of large, diverse, and high-quality datasets, which can be challenging to obtain due to data scarcity, privacy concerns, and high costs. Synthetic data has emerged as a promising solution by generating artificial data that mimics real-world patterns. This paper provides an overview of synthetic data research, discussing its applications, challenges, and future directions. We present empirical evidence from prior art to demonstrate its effectiveness and highlight the importance of ensuring its factuality, fidelity, and unbiasedness. We emphasize the need for responsible use of synthetic data to build more powerful, inclusive, and trustworthy language models.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论danielmarkbruce · 2024-10

“There is a lot of nonsense in here, for example: > but we know that synthetic datasets make for poor training data This is a silly generalization. Just google "synthetic data for training LLMs" and you'll find a bunch of papers on it. Here's a decent survey: https://arxiv.org/pdf/2404.07503 It's very likely o1 used synthetic data to train the model and…”

Canvas is a new way to write and code with ChatGPT原评论 ↗
评论seanhunter · 2024-12

“Ilya could be wrong. I don’t think the question is decided yet in general. We already know that in lots of fields fake data can be used in ways that are as useful as or even more useful than the real thing[1], but in my understanding that tends to be situations where we have an objective function that is unambiguous and known beforehand. Meta has some ver…”

Ilya Sutskever NeurIPS talk [video]原评论 ↗