Edinburgh Research Explorer

Measuring the Gap Between HMM-Based ASR and TTS

Research output: Contribution to journalArticle

Original languageEnglish
Pages (from-to)1046-1058
Number of pages13
JournalIEEE Journal of Selected Topics in Signal Processing
Volume4
Issue number6
DOIs
Publication statusPublished - 1 Dec 2010

Abstract

The EMIME European project is conducting research in the development of technologies for mobile, personalized speech-to-speech translation systems. The hidden Markov model (HMM) is being used as the underlying technology in both automatic speech recognition (ASR) and text-to-speech synthesis (TTS) components; thus, the investigation of unified statistical modeling approaches has become an implicit goal of our research. As one of the first steps towards this goal, we have been investigating commonalities and differences between HMM-based ASR and TTS. In this paper, we present results and analysis of a series of experiments that have been conducted on English ASR and TTS systems measuring their performance with respect to phone set and lexicon, acoustic feature type and dimensionality, HMM topology, and speaker adaptation. Our results show that, although the fundamental statistical model may be essentially the same, optimal ASR and TTS performance often demands diametrically opposed system designs. This represents a major challenge to be addressed in the investigation of such unified modeling approaches.

Download statistics

No data available

ID: 241667