按年被提到
20162017 · 1 次2026
机器学习与深度学习›贝叶斯方法与 AutoML·arXiv:1610.05735 · cs.AI

Deep Amortized Inference for Probabilistic Programs

Daniel Ritchie, Paul Horsfall, Noah D. Goodman · 2016
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2017-11-05 · 最近 2021-09-14
2不同的人
2活跃月份
2讨论串
37被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Probabilistic programming languages (PPLs) are a powerful modeling tool, able to represent any computable probability distribution. Unfortunately, probabilistic program inference is often intractable, and existing PPLs mostly rely on expensive, approximate sampling-based methods. To alleviate this problem, one could try to learn from past inferences, so that future inferences run faster. This strategy is known as amortized inference; it has recently been applied to Bayesian networks and deep generative models. This paper proposes a system for amortized inference in PPLs. In our system, amortization comes in the form of a parameterized guide program. Guide programs have similar structure to the original program, but can have richer data flow, including neural network components. These networks can be optimized so that the guide approximately samples from the posterior distribution defined by the original program. We present a flexible interface for defining guide programs and a stochastic gradient-based scheme for optimizing guide parameters, as well as some preliminary results on automatically deriving guide programs. We explore in detail the common machine learning pattern in which a 'local' model is specified by 'global' random values and used to generate independent observed data points; this gives rise to amortized local inference supporting global model learning.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论fritzo · 2017-11

“Thanks for being honest:) >...difficulty of finding out what the actual interesting bits are. > Uber's more detailed writeup... is vague We indeed struggled to balance accessibility and depth that blog post. One place to go deeper is the Pyro tutorials http://pyro.ai/examples For more technical framing, take a look at Noah's paper [1]. Broadly I thin…”

Pyro: PyTorch-Based Deep Universal Probabilistic Programming原评论 ↗
评论nextos · 2021-09

“Apologies, for the late reply. By deep functions I simply meant small deep networks embedded in probabilistic models as a drop-in replacement for probability distributions, like e.g. a neuralHMM: https://pyro.ai/examples/hmm_funsor.html Aside from looking into Pyro docs and all references, another good entry point is this publication: https://arxiv.org/…”

Interpretable Model-Based Hierarchical RL Using Inductive Logic Programming原评论 ↗