按年被提到
20192019 · 2 次2026
视觉、语音与图像生成›视觉语言与自监督表征·arXiv:1906.01618 · cs.CV

Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations

Vincent Sitzmann, Michael Zollhöfer, Gordon Wetzstein · 2019
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2019-10-11 · 最近 2019-12-10
2不同的人
2活跃月份
2讨论串
685被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Unsupervised learning with generative models has the potential of discovering rich representations of 3D scenes. While geometric deep learning has explored 3D-structure-aware representations of scene geometry, these models typically require explicit 3D supervision. Emerging neural scene representations can be trained only with posed 2D images, but existing methods ignore the three-dimensional structure of scenes. We propose Scene Representation Networks (SRNs), a continuous, 3D-structure-aware scene representation that encodes both geometry and appearance. SRNs represent scenes as continuous functions that map world coordinates to a feature representation of local scene properties. By formulating the image formation as a differentiable ray-marching algorithm, SRNs can be trained end-to-end from only 2D images and their camera poses, without access to depth or shape. This formulation naturally generalizes across scenes, learning powerful geometry and appearance priors in the process. We demonstrate the potential of SRNs by evaluating them for novel view synthesis, few-shot reconstruction, joint shape and appearance interpolation, and unsupervised discovery of a non-rigid face model.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论nmca · 2019-10

“At some point you stop caring about being able to import a set of imagnet pretrained weights and start caring about extreme flexibility. Think about implement ting, say "Scene Representation Networks" https://arxiv.org/abs/1906.01618 in each of the three frameworks. Tf is a pig, pytorch is slow, and Jax is going to crush the problem. The lack of say, ker…”

The State of Machine Learning Frameworks原评论 ↗
评论etaioinshrdlu · 2019-12

“Being able to measure our successes and failures is the first step towards better algorithms:) This is always exciting. I don't think anyone thought that vanilla CNN architectures were all that would ever be needed. This paper which received an honorable mention this year from NeurIPS conference first attempts to convert the image to a 3d scene before d…”

Object-recognition dataset stumped the world’s best computer vision models原评论 ↗