按年被提到
20182018 · 1 次2026
视觉、语音与图像生成›语音与音频生成·arXiv:1802.06006 · cs.CL

Neural Voice Cloning with a Few Samples

Sercan O. Arik, Jitong Chen, Kainan Peng, Wei Ping, Yanqi Zhou · 2018
开始阅读 ↗PDFalphaXiv 讨论
被提及 · 2 人首次 2018-03-01 · 最近 2022-02-25
2不同的人
2活跃月份
2讨论串
229被引(OpenAlex)
arXiv 摘要(候选层不写导读)

Voice cloning is a highly desired feature for personalized speech interfaces. Neural network based speech synthesis has been shown to generate high quality speech for a large number of speakers. In this paper, we introduce a neural voice cloning system that takes a few audio samples as input. We study two approaches: speaker adaptation and speaker encoding. Speaker adaptation is based on fine-tuning a multi-speaker generative model with a few cloning samples. Speaker encoding is based on training a separate model to directly infer a new speaker embedding from cloning audios and to be used with a multi-speaker generative model. In terms of naturalness of the speech and its similarity to original speaker, both approaches can achieve good performance, even with very few cloning audios. While speaker adaptation can achieve better naturalness and similarity, the cloning time or required memory for the speaker encoding approach is significantly less, making it favorable for low-resource deployment.

候选层:至少 2 个不同的人、在 2 个不同月份提到过,还没到主书架的 3 人 3 个月。没有做立场标注,所以只写“被提及”。

HN 书评

推荐在前,同类按时间 · 每篇最多保留 20 条,统计用全部提及
评论abdljasser2 · 2022-02

“In 2020, Magenta released DDSP [1], a machine learning algorithm / python library which made it possible to generate good sounding instrument synthesizers from about 6-10 minutes of data. While working with DDSP for a project, we realised how it was actually quite hard to find 6-10 minute of clean recordings of monophonic instruments. In this project, w…”

Show HN: Cloning a musical instrument from 16 seconds of audio原评论 ↗
被提交为 story · 1 次