按年被提到
20212022 · 1 次2026
强化学习与智能体›博弈与游戏 AI·arXiv:2104.03113 · cs.LG

Scaling Scaling Laws with Board Games

Andy L. Jones · 2021
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2022-08-19 · 最近 2023-03-10
2不同的人
2活跃月份
2讨论串
12被引(OpenAlex)
arXiv 摘要(候选层不写导读)

The largest experiments in machine learning now require resources far beyond the budget of all but a few institutions. Fortunately, it has recently been shown that the results of these huge experiments can often be extrapolated from the results of a sequence of far smaller, cheaper experiments. In this work, we show that not only can the extrapolation be done based on the size of the model, but on the size of the problem as well. By conducting a sequence of experiments using AlphaZero and Hex, we show that the performance achievable with a fixed amount of compute degrades predictably as the game gets larger and harder. Along with our main result, we further show that the test-time and train-time compute available to an agent can be traded off while maintaining performance.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论gwern · 2022-08

“> it isn't immediately clear that current RL algorithms will neatly scale with data & parameter count It may not be immediately clear, but it is nevertheless unfortunately clear from RL papers which provide adequate sample-size or compute ranges that RL appears to follow scaling laws (just like everywhere else anyone bothers to test). Yeah, they just get…”

John Carmack's new AGI company, Keen Technologies, has raised a $20M round原评论 ↗
评论espadrine · 2023-03

“Model sizes are adjusted to reach a given quality. Many papers justified empirically the use of more neurons allocated to language than to visual understanding, like Imagen[0] (figure 4.a). as it yields better results. Debatably, it is also true in the human brain. To me, it could highlight that there is more entropy in language than in images. After all…”

Visual ChatGPT原评论 ↗