Edinburgh Research Explorer

A study of speaker adaptation for DNN-based speech synthesis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Original languageEnglish
Title of host publicationProceedings of Interspeech 2015
PublisherInternational Speech Communication Association
DOIs
Publication statusPublished - 6 Sep 2015
EventInterspeech 2015 - Dresden, Germany
Duration: 6 Sep 20159 Sep 2015

Conference

ConferenceInterspeech 2015
CountryGermany
CityDresden
Period6/09/159/09/15

Abstract

A major advantage of statistical parametric speech synthe- sis (SPSS) over unit-selection speech synthesis is its adapt- ability and controllability in changing speaker characteristics and speaking style. Recently, several studies using deep neural networks (DNNs) as acoustic models for SPSS have shown promising results. However, the adaptability of DNNs in SPSS has not been systematically studied. In this paper, we conduct an experimental analysis of speaker adaptation for DNN-based speech synthesis at different levels. In particular, we augment a low-dimensional speaker-specific vector with linguistic features as input to represent speaker identity, perform model adaptation to scale the hidden activation weights, and perform a fea- ture space transformation at the output layer to modify generated acoustic features. We systematically analyse the performance of each individual adaptation technique and that of their combinations. Experimental results confirm the adaptability of the DNN, and listening tests demonstrate that the DNN can achieve significantly better adaptation performance than the hidden Markov model (HMM) baseline in terms of naturalness and speaker similarity.

    Research areas

  • Speech synthesis, acoustic model, Deep Neural Networks, speaker adaptation

Event

Interspeech 2015

6/09/159/09/15

Dresden, Germany

Event: Conference

Download statistics

No data available

ID: 19840708