Prediction and Realisation of Conversational Characteristics by Utilising Spontaneous Speech for Unit Selection

Matthew Aylett, Robert A. J. Clark, Sebastian Andersson, Kallirroi Georgila, David Traum

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Unit selection speech synthesis has reached high levels of naturalness and intelligibility for neutral read aloud speech. However, synthetic speech generated using neutral read aloud data lacks all the attitude, intention and spontaneity associated with everyday conversations. Unit selection is heavily data dependent and thus in order to simulate human conversational speech, or create synthetic voices for believable virtual characters, we need to utilise speech data with examples of how people talk rather than how people read. In this paper we included carefully selected utterances from spontaneous conversational speech in a unit selection voice. Using this voice and by automatically predicting type and placement of lexical fillers and filled pauses we can synthesise utterances with conversational characteristics. A perceptual listening test showed that it is possible to make synthetic speech sound more conversational without degrading naturalness.
Original languageEnglish
Title of host publicationSpeech Prosody 2010
Publication statusPublished - May 2010

Fingerprint Dive into the research topics of 'Prediction and Realisation of Conversational Characteristics by Utilising Spontaneous Speech for Unit Selection'. Together they form a unique fingerprint.

Cite this