Edinburgh Research Explorer

Analysis of statistical parametric and unit selection speech synthesis systems applied to emotional speech

Research output: Contribution to journalArticle

Related Edinburgh Organisations

Open Access permissions



  • Download as Adobe PDF

    Rights statement: © Analysis of statistical parametric and unit selection speech synthesis systems applied to emotional speech. / Barra-Chicote, Roberto; Yamagishi, Junichi; King, Simon; Montero, Juan Manuel; Macias-Guarasa, Javier. In: Speech Communication, Vol. 52, No. 5, 01.05.2010, p. 394-404. Research output: Contribution to journal › Article

    Accepted author manuscript, 452 KB, PDF document

Original languageEnglish
Pages (from-to)394-404
Number of pages11
JournalSpeech Communication
Issue number5
Publication statusPublished - 1 May 2010


We have applied two state-of-the-art speech synthesis techniques (unit selection and HMM-based synthesis) to the synthesis of emotional speech. A series of carefully designed perceptual tests to evaluate speech quality, emotion identification rates and emotional strength were used for the six emotions which we recorded - happiness, sadness, anger, surprise, fear, disgust. For the HMM-based method, we evaluated spectral and source components separately and identified which components contribute to which emotion.

Our analysis shows that, although the HMM method produces significantly better neutral speech, the two methods produce emotional speech of similar quality, except for emotions having context-dependent prosodic patterns. Whilst synthetic speech produced using the unit selection method has better emotional strength scores than the HMM-based method, the HMM-based method has the ability to manipulate the emotional strength. For emotions that are characterized by both spectral and prosodic components, synthetic speech using unit selection methods was more accurately identified by listeners. For emotions mainly characterized by prosodic components, HMM-based synthetic speech was more accurately identified. This finding differs from previous results regarding listener judgements of speaker similarity for neutral speech. We conclude that unit selection methods require improvements to prosodic modeling and that HMM-based methods require improvements to spectral modeling for emotional speech. Certain emotions cannot be reproduced well by either method.

    Research areas

  • Emotional speech synthesis , HMM-based synthesis , Unit selection

Download statistics

No data available

ID: 184655