按年被提到
20252025 · 6 次2026
大模型与语言模型›大模型推理与思维链·arXiv:2510.14901 · cs.LG

Reasoning with Sampling: Your Base Model is Smarter Than You Think

Aayush Karan, Yilun Du · 2025
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 6 人首次 2025-10-20 · 最近 2025-12-13
6不同的人
2活跃月份
6讨论串
5被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Frontier reasoning models have exhibited incredible capabilities across a wide array of disciplines, driven by posttraining large language models (LLMs) with reinforcement learning (RL). However, despite the widespread success of this paradigm, much of the literature has been devoted to disentangling truly novel behaviors that emerge during RL but are not present in the base models. In our work, we approach this question from a different angle, instead asking whether comparable reasoning capabilites can be elicited from base models at inference time by pure sampling, without any additional training. Inspired by Markov chain Monte Carlo (MCMC) techniques for sampling from sharpened distributions, we propose a simple iterative sampling algorithm leveraging the base models' own likelihoods. Over different base models, we show that our algorithm offers substantial boosts in reasoning that nearly match and even outperform those from RL on a wide variety of single-shot tasks, including MATH500, HumanEval, and GPQA. Moreover, our sampler avoids the collapse in diversity over multiple samples that is characteristic of RL-posttraining. Crucially, our method does not require training, curated datasets, or a verifier, suggesting broad applicability beyond easily verifiable domains.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论AlexCoventry · 2025-12

“The warmup process is necessary in order to try to find high-probability regions of the target distribution. That's not an issue for an LLM, since it's trained to sample directly from a distribution which looks like natural language. There is some work on using MCMC to sample from higher-probability regions of an LLM distribution [1], but that's a separa…”

What I don’t like about chains of thoughts (2023)原评论 ↗
被提交为 story · 5 次