按年被提到
20242025 · 2 次2026
强化学习与智能体›博弈与游戏 AI·arXiv:2403.15498 · cs.LG

Emergent World Models and Latent Variable Estimation in Chess-Playing Language Models

Adam Karvonen · 2024
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2024-09-06 · 最近 2026-02-19
2不同的人
4活跃月份
5讨论串
12被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Language models have shown unprecedented capabilities, sparking debate over the source of their performance. Is it merely the outcome of learning syntactic patterns and surface level statistics, or do they extract semantics and a world model from the text? Prior work by Li et al. investigated this by training a GPT model on synthetic, randomly generated Othello games and found that the model learned an internal representation of the board state. We extend this work into the more complex domain of chess, training on real games and investigating our model's internal representations using linear probes and contrastive activations. The model is given no a priori knowledge of the game and is solely trained on next character prediction, yet we find evidence of internal representations of board state. We validate these internal representations by using them to make interventions on the model's activations and edit its internal board state. Unlike Li et al's prior synthetic dataset approach, our analysis finds that the model also learns to estimate latent variables like player skill to better predict the next character. We derive a player skill vector and add it to the model, improving the model's win rate by up to 2.6 times.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论famouswaffles · 2024-09

“>the model will learn what it can to minimize the error over the specific provided loss function, and no more. Change the loss function and you change what the model learns. You clearly do not really understand what it means to predict internet scale text with increasing accuracy. No more than that ? Fantastic LLMs do not just learn surface statistics. …”

Ilya Sutskever's SSI Inc raises $1B原评论 ↗
评论famouswaffles · 2025-07

“LLMs playing chess isn't a big deal. You can train a model on chess games and it will play at a decent ELO and very rarely make illegal moves(i.e 99.8% legal move rate). There are a few such models around. I think post training messes with chess ability and Open ai et al just don't really care about that. But LLMs can play chess just fine. [0] https://ar…”

AI is a floor raiser, not a ceiling raiser原评论 ↗
评论timschmidt · 2025-10

“> Can you please explain how we can discern that GPT-2 in this instance really built a model of the board? Read the article. It's very clear. To quote it: "Next, I wanted to see if my model could accurately track the state of the board. A quick overview of linear probes: We can take the internal activations of a model as it’s predicting the next token, …”

Andrej Karpathy – It will take a decade to work through the issues with agents原评论 ↗
评论famouswaffles · 2026-02

“>They still make these errors on anything that is out of distribution. There is literally a post in this thread linking to a chat where Sonnet failed a basic arithmetic puzzle: https://news.ycombinator.com/item?id=47051286 I thought we were talking about actual arithmetic not silly puzzles, and there are many human adults that would fail this, nevermind …”

Claude Sonnet 4.6 System Card原评论 ↗
评论famouswaffles · 2026-02

“Relax. Anyone who's genuinely interested in the question will see with a few searches that LLMs can play chess fine, although the post-trained models mostly seem to be regressed. Problem is people are more interested in validating their own assumptions than anything else. https://arxiv.org/abs/2403.15498 https://arxiv.org/abs/2501.17186 https://github.…”

Stop Thinking of AI as a Coworker. It's an Exoskeleton原评论 ↗