按年被提到
20152016 · 2 次2026
视觉、语音与图像生成›语音与音频生成·arXiv:1512.08512 · cs.CV

Visually Indicated Sounds

Andrew Owens, Phillip Isola, Josh McDermott, Antonio Torralba, Edward H. Adelson, William T. Freeman · 2015
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2016-06-14 · 最近 2016-11-24
2不同的人
2活跃月份
2讨论串
357被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Objects make distinctive sounds when they are hit or scratched. These sounds reveal aspects of an object's material properties, as well as the actions that produced them. In this paper, we propose the task of predicting what sound an object makes when struck as a way of studying physical interactions within a visual scene. We present an algorithm that synthesizes sound from silent videos of people hitting and scratching objects with a drumstick. This algorithm uses a recurrent neural network to predict sound features from videos and then produces a waveform from these features with an example-based synthesis procedure. We show that the sounds predicted by our model are realistic enough to fool participants in a "real or fake" psychophysical experiment, and that they convey significant information about material properties and physical interactions.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论visarga · 2016-06

“> But the title makes it seem like the algorithm is synthesizing the sounds from scratch! It does. If you read the paper, they say that first they went with matching sounds from a database, but later turned on to full synthesis. Reference: look for "parametric synthesis" in the paper https://arxiv.org/pdf/1512.08512v2.pdf”

AI produces realistic sounds that fool humans原评论 ↗
被提交为 story · 1 次