按年被提到
20172019 · 1 次2026
机器学习与深度学习›贝叶斯方法与 AutoML·arXiv:1703.00854 · cs.LG

Learning the Structure of Generative Models without Labeled Data

Stephen H. Bach, Bryan He, Alexander Ratner, Christopher Ré · 2017
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2019-03-15 · 最近 2020-07-16
2不同的人
2活跃月份
2讨论串
113被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Curating labeled training data has become the primary bottleneck in machine learning. Recent frameworks address this bottleneck with generative models to synthesize labels at scale from weak supervision sources. The generative model's dependency structure directly affects the quality of the estimated labels, but selecting a structure automatically without any labeled data is a distinct challenge. We propose a structure estimation method that maximizes the $\ell_1$-regularized marginal pseudolikelihood of the observed data. Our analysis shows that the amount of unlabeled data required to identify the true structure scales sublinearly in the number of possible dependencies for a broad class of models. Simulations show that our method is 100$\times$ faster than a maximum likelihood approach and selects $1/4$ as many extraneous dependencies. We also show that our method provides an average of 1.5 F1 points of improvement over existing, user-developed information extraction applications on real-world data such as PubMed journal abstracts.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论polm23 · 2020-07

“The Snorkel paper doesn't cover this in depth, the math is all in this paper: https://arxiv.org/abs/1703.00854 I can't say I followed all the proofs, but it seems that under certain limited assumptions about labelling functions they prove their generative function can do well. Reading Snorkel it initially sounded like magic in the bad way, but this doe…”

Snorkel AI: Putting Data First in ML Development原评论 ↗
被提交为 story · 1 次