按年被提到
20202023 · 2 次2026
视觉、语音与图像生成›ViT 与视觉新架构·arXiv:2006.10739 · cs.CV

Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains

Matthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T. Barron, Ren Ng · 2020
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2023-02-28 · 最近 2023-08-21
2不同的人
2活跃月份
2讨论串
1,482被引(OpenAlex)
arXiv 摘要(候选层不写导读)

We show that passing input points through a simple Fourier feature mapping enables a multilayer perceptron (MLP) to learn high-frequency functions in low-dimensional problem domains. These results shed light on recent advances in computer vision and graphics that achieve state-of-the-art results by using MLPs to represent complex 3D objects and scenes. Using tools from the neural tangent kernel (NTK) literature, we show that a standard MLP fails to learn high frequencies both in theory and in practice. To overcome this spectral bias, we use a Fourier feature mapping to transform the effective NTK into a stationary kernel with a tunable bandwidth. We suggest an approach for selecting problem-specific Fourier features that greatly improves the performance of MLPs for low-dimensional regression tasks relevant to the computer vision and graphics communities.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论gessha · 2023-02

“In a recent-ish paper, there was an analysis of positional encodings using Neural Tangent Kernels which showed positional encodings are very similar to Fourier transformations of the inputs: Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains, https://arxiv.org/abs/2006.10739”

200-Year-Old Math Opens Up AI’s Mysterious Black Box原评论 ↗
评论allangrant · 2023-08

“A video about neural networks, function approximation, machine learning, and mathematical building blocks. This is a submission for #SoME3 (0:00) Functions Describe the World (3:15) Neural Architecture (5:35) Higher Dimensions (11:55) Taylor Series (15:20) Fourier Series (21:25) The Real World (24:32) An Open Challenge Links and Content: • On Mat…”

Watching Neural Networks Learn [video]原评论 ↗