按年被提到
20182019 · 2 次2026
大模型与语言模型›可解释性与表征研究·arXiv:1811.12359 · cs.LG

Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations

Francesco Locatello, Stefan Bauer, Mario Lucic, Gunnar Rätsch, Sylvain Gelly, Bernhard Schölkopf, Olivier Bachem · 2018
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2019-04-25 · 最近 2019-07-14
2不同的人
2活跃月份
2讨论串
842被引(OpenAlex)
arXiv 摘要(候选层不写导读)

The key idea behind the unsupervised learning of disentangled representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this paper, we provide a sober look at recent progress in the field and challenge some common assumptions. We first theoretically show that the unsupervised learning of disentangled representations is fundamentally impossible without inductive biases on both the models and the data. Then, we train more than 12000 models covering most prominent methods and evaluation metrics in a reproducible large-scale experimental study on seven different data sets. We observe that while the different methods successfully enforce properties ``encouraged'' by the corresponding losses, well-disentangled models seemingly cannot be identified without supervision. Furthermore, increased disentanglement does not seem to lead to a decreased sample complexity of learning for downstream tasks. Our results suggest that future work on disentanglement learning should be explicit about the role of inductive biases and (implicit) supervision, investigate concrete benefits of enforcing disentanglement of the learned representations, and consider a reproducible experimental setup covering several data sets.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论chronolitus · 2019-07

“As someone who works on ML, in particular 'deep neural networks', I am always surprised when someone seriously mentions using them to solve complex (anything with humans in the loop fits solidly within this category) real-world (i.e. real-world inputs and outputs) problems. I am very surprised when the problem definition additionally involves potential in…”

Multi-Task Learning in the Wilderness: Karpathy on Autopilot progress [video]原评论 ↗
被提交为 story · 1 次