“and this news hit me as "finally, evidence enough to intrigue more people that this is possible!"”
Amortized Planning with Large-Scale Transformers: A Case Study on Chess
无搜索的 Transformer 蒸馏 Stockfish,达到特级大师棋力
作者发布 ChessBench 数据集(1000 万局棋、150 亿个数据点,由 Stockfish 16 标注走法合法性与价值),用监督学习训练至多 2.7 亿参数的 Transformer 预测状态价值、动作价值和行为克隆目标。最大的模型不做任何显式搜索,在 Lichess 闪电战中达到 2895 Elo(特级大师水平)并能解出难题,但对 Stockfish 搜索算法的蒸馏仍不完美。
HN 评论者把它当作「不做搜索也能下出特级大师水平的棋」的证据反复引用,也有人批评特级大师水平对棋类程序其实并不算强。
HN 书评
推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及“The big problem with that paper is that grandmaster level chess is actually really bad for a chess bot.”
“If we find we need to rewrite the tokenizer for every problem variant, then I argue this is just ordinary programming in a very expensive disguise.”
“the LLM-based model that Deep Mind announced a couple of weeks ago”
“So the last frontier of human expertise in chess is search heuristics”
“Deep Mind tried [3] this.”
看全部 19 条 →
“I'm planning on comparing with this paper [2] which achieves GM level chess without any search.”
“We have a chess transformer playing world class chess (grandmaster level) - Amortized Planning with Large-Scale Transformers.”
“This repository provides an implementation of our paper Grandmaster-Level Chess Without Search.”
“So I guess when LLMs play chess at 2800 ELO they are just taking a vote on what top grand masters would play in the given position.”
“A recent discovery showing that computer chess (which was traditionally based on searching a combinatorial space, i.e. NP-hard) that is instead now being solved with transformer models, is actually playing better at the ELO level.”
“google developed a LLM that can play chess. And play it at grandmaster level: Amortized Planning with Large-Scale Transformers”
“In Google's paper, then titled "Grandmaster level chess without search", they evaluate turbo-instruct to have a lichess Elo of 1755 (vs bots)”
“There are several neural network based engines these days, including one that does exclusively what you describe (i.e. "patterns only", no calculation at all)”
“Even in the highly constrained realm of chess, an enormous neural net will be outclassed by a small program that can run on your phone.”
“And there's this grandmaster level transformer - Amortized Planning with Large-Scale Transformers”
“Then there's this grandmaster level chess transformer - Amortized Planning with Large-Scale Transformers.”
“There are chess engines based on transformers, even DeepMind released one [1]. It achieved ~2900 Elo.”
“See for example the chess transformer built by DeepMind a couple of years ago which I referred to in a sibling comment [1].”
- Grandmaster-Level Chess Without Search ↗unstuck3958 · 2024-02-08 · 7 分