按年被提到
20182019 · 1 次2026
机器学习与深度学习›深度学习理论与泛化·arXiv:1805.10451 · cs.LG

Geometric Understanding of Deep Learning

Na Lei, Zhongxuan Luo, Shing-Tung Yau, David Xianfeng Gu · 2018
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2019-01-24 · 最近 2021-02-14
2不同的人
2活跃月份
2讨论串
31被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Deep learning is the mainstream technique for many machine learning tasks, including image recognition, machine translation, speech recognition, and so on. It has outperformed conventional methods in various fields and achieved great successes. Unfortunately, the understanding on how it works remains unclear. It has the central importance to lay down the theoretic foundation for deep learning. In this work, we give a geometric view to understand deep learning: we show that the fundamental principle attributing to the success is the manifold structure in data, namely natural high dimensional data concentrates close to a low-dimensional manifold, deep learning learns the manifold and the probability distribution on it. We further introduce the concepts of rectified linear complexity for deep neural network measuring its learning capability, rectified linear complexity of an embedding manifold describing the difficulty to be learned. Then we show for any deep neural network with fixed architecture, there exists a manifold that cannot be learned by the network. Finally, we propose to apply optimal mass transportation theory to control the probability distribution in the latent space.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论ghufran_syed · 2021-02

“that course from princeton looks great! This paper is a nice short read and gives some geometric insight: https://arxiv.org/abs/1805.10451”

DeepMind achieves SOTA image recognition with 8.7x faster training原评论 ↗
被提交为 story · 1 次