Speaker Alignment in Synthesised, Machine Translated Communication

A.H. Schneider, S. Luz

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

The effect of mistranslations on the verbal behaviour of users of speech-to-speech translation is investigated through a question answering experiment in which users were presented with machine translated questions through synthesised speech. Results show that people are likely to align their verbal behaviour to the output of a system that combines machine translation, speech recognition and speech synthesis in an interactive dialogue context, even when the system produces erroneous output. The alignment phenomenon has been previously considered by dialogue system designers from the perspective of the benefits it might bring to the interaction (e.g. by making the user more likely to employ terms contained in the system’s vocabulary). In contrast, our results reveal that in speech-to-speech translation systems alignment can in fact be detrimental to the interaction (e.g. by priming the user to align with non-existing lexical items produced by mistranslation). The implications of these findings are discussed with respect to the design of such systems
Original languageUndefined/Unknown
Title of host publicationInternational Workshop on Spoken Language Translation
Pages254-260
Number of pages7
Publication statusPublished - Dec 2011

Cite this