Phoneme dependent speaker embedding and model factorization for multi-speaker speech synthesis and adaptation | |
Fu, Ruibo1,3; Tao, Jianhua1,2,3; Wen, Zhengqi3; Zheng, Yibin1,3 | |
2019-05 | |
会议日期 | MAY 12-17,2019 |
会议地点 | Brighton,UK |
关键词 | speech synthesis speaker adaptation speaker embedding phoneme representation |
页码 | 6930-6934 |
英文摘要 | This paper presents an architecture to perform speaker adaption in long short-term memory (LSTM) based Mandarin statistical parametric speech synthesis system. Compared with the conventional methods that focused on using fixed global speaker representations in utterance level for speaker recognition task, the proposed method extracts speaker representations in utterance and phoneme level, which can describe more pronunciation characteristics in phoneme level. And an attention mechanism is deployed to combine each level representations dynamically to train a task-specific phoneme dependent speaker embedding. To handle the unbalanced database and avoid over-fitting, the model is factored into an average model and an adaptation model and combined by an attention mechanism. We investigate the performance of speaker representations extracted by different methods. Experimental results confirm the adaptability of our proposed speaker embedding and model factorization structure. And listening tests demonstrate that our proposed method can achieve better adaptation performance than baselines in terms of naturalness and speaker similarity. |
会议录出版者 | IEEE |
语种 | 英语 |
内容类型 | 会议论文 |
源URL | [http://ir.ia.ac.cn/handle/173211/39591] |
专题 | 模式识别国家重点实验室_智能交互 |
通讯作者 | Tao, Jianhua |
作者单位 | 1.CAS Center for Excellence in Brain Science and Intelligence Technology 2.School of Artificial Intelligence, University of Chinese Academy of Sciences 3.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences |
推荐引用方式 GB/T 7714 | Fu, Ruibo,Tao, Jianhua,Wen, Zhengqi,et al. Phoneme dependent speaker embedding and model factorization for multi-speaker speech synthesis and adaptation[C]. 见:. Brighton,UK. MAY 12-17,2019. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论