按年被提到
20202023 · 2 次2026
社会、经济与科学研究›统计、金融与复杂系统·arXiv:2011.03567 · stat.ME

Anytime-Valid Inference for Multinomial Count Data

Michael Lindon, Alan Malek · 2020
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2023-02-05 · 最近 2023-06-16
2不同的人
2活跃月份
2讨论串
10被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Many experiments are concerned with the comparison of counts between treatment groups. Examples include the number of successful signups in conversion rate experiments, or the number of errors produced by software versions in canary experiments. Observations typically arrive in data streams and practitioners wish to continuously monitor their experiments, sequentially testing hypotheses while maintaining Type I error probabilities under optional stopping and continuation. These goals are frequently complicated in practice by non-stationary time dynamics. We provide practical solutions through sequential tests of multinomial hypotheses, hypotheses about many inhomogeneous Bernoulli processes and hypotheses about many time-inhomogeneous Poisson counting processes. For estimation, we further provide confidence sequences for multinomial probability vectors, all contrasts among probabilities of inhomogeneous Bernoulli processes and all contrasts among intensities of time-inhomogeneous Poisson counting processes. Together, these provide an "anytime-valid" inference framework for a wide variety of experiments dealing with count outcomes, which we illustrate with a number of industry applications.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论travisjungroth · 2023-02

“I didn’t see it linked, but a paper by my coworker at Netflix, Michael Lindon, seems relevant: Anytime-Valid Inference for Multinomial Count Data. https://arxiv.org/abs/2011.03567”

Review of statistical methods to accelerate the speed of A/B testing原评论 ↗
评论kimukasetsu · 2023-06

“The biggest mistake engineers make is determining sample sizes. It is not trivial to determine the sample size for a trial without prior knowledge of effect sizes. Instead of waiting for a fixed sample size, I would recommend using a sequential testing framework: set a stopping condition and perform a test for each new batch of sample units. This is call…”

Annoying A/B testing mistakes every engineer should know原评论 ↗