按年被提到
20092014 · 1 次2026
社会、经济与科学研究›科研评价与算法公平·arXiv:0907.2478 · stat.AP

Why we (usually) don't have to worry about multiple comparisons

Andrew Gelman, Jennifer Hill, Masanao Yajima · 2009
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2014-02-23 · 最近 2022-10-19
2不同的人
2活跃月份
2讨论串
16被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Applied researchers often find themselves making statistical inferences in settings that would seem to require multiple comparisons adjustments. We challenge the Type I error paradigm that underlies these corrections. Moreover we posit that the problem of multiple comparisons can disappear entirely when viewed from a hierarchical Bayesian perspective. We propose building multilevel models in the settings where multiple comparisons arise. Multilevel models perform partial pooling (shifting estimates toward each other), whereas classical procedures typically keep the centers of intervals stationary, adjusting for multiple comparisons by making the intervals wider (or, equivalently, adjusting the $p$-values corresponding to intervals of fixed width). Thus, multilevel models address the multiple comparisons problem and also yield more efficient estimates, especially in settings with low group-level variation, which is where multiple comparisons are a particular concern.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论tristanz · 2014-02

“Putting aside bandits and all that, it seems like the first step should be to set up a hierarchical prior which performs shrinkage. Multiple comparisons and stopping issues are largely due to using frequentist tests rather than a simple probabilistic model and inference that conditions and the observed data. Gelman et al, "Why we (usually) don't have to …”

Most Winning A/B Test Results are Illusory [pdf]原评论 ↗
评论nextos · 2022-10

“A good way to address these issues is to frame all experiments as multilevel models. See [1] for a long discussion from Andrew Gelman et al on why this is advisable. Surprisingly, many people working in statistics still ignore the James-Stein theorem, which provides a theoretical justification for multilevel models. In layman terms, said theorem shows th…”

Why most published research findings are false (2005)原评论 ↗