Robust Speaker-Adaptive HMM-Based Text-to-Speech Synthesis

J. Yamagishi, T. Nose, H. Zen, Z. H. Ling, T. Toda, K. Tokuda, S. King, S. Renals

Research output: Contribution to journalArticlepeer-review


This paper describes a speaker-adaptive HMM-based speech synthesis system. The new system, called ldquoHTS-2007,rdquo employs speaker adaptation (CSMAPLR+MAP), feature-space adaptive training, mixed-gender modeling, and full-covariance modeling using CSMAPLR transforms, in addition to several other techniques that have proved effective in our previous systems. Subjective evaluation results show that the new system generates significantly better quality synthetic speech than speaker-dependent approaches with realistic amounts of speech data, and that it bears comparison with speaker-dependent approaches even when large amounts of speech data are available. In addition, a comparison study with several speech synthesis techniques shows the new system is very robust: It is able to build voices from less-than-ideal speech data and synthesize good-quality speech even for out-of-domain sentences.
Original languageEnglish
Pages (from-to)1208-1230
Number of pages23
JournalIEEE Transactions on Audio, Speech and Language Processing
Issue number6
Publication statusPublished - Aug 2009

Fingerprint Dive into the research topics of 'Robust Speaker-Adaptive HMM-Based Text-to-Speech Synthesis'. Together they form a unique fingerprint.

Cite this