A speech-to-speech, machine translation mediated map task: An exploratory study

Loredana Cerrato*, Hayakawa Akira, Nick Campbell, Saturnino Luz

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)peer-review

Abstract / Description of output

The aim of this study is to investigate how the language technologies of Automatic Speech Recognition (ASR), Machine Translation (MT), and Text To Speech (TTS) synthesis affect users during an interlingual interaction. In this paper, we describe the prototype system used for the data collection, we give details of the collected data and report the results of a usability test run to assess how the users of the interlingual system evaluate the interactions in a collaborative map task. We use widely adopted usability evaluation measures: ease of use, effectiveness and users satisfaction, and look at both qualitative and quantitative measures. Results indicate that both users taking part in the dialogues (instructions giver and follower) found the system similarly satisfactory in terms of ease of learning, ease of use, and pleasantness, even if they were less satisfied with its effectiveness in supporting the task. Users employed different strategies in order to adapt to the shortcomings of the technology, such as hyper-articulation, and rewording of utterances in relation to error of the ASR. We also report the results of a comparison of the map task in two different settings – one that includes a constant video stream (“video-on”) and one that does not (“no-video.”) Surprisingly, users rated the no-video setting consistently better.

Original languageEnglish
Title of host publicationFuture and Emergent Trends in Language Technology
Subtitle of host publicationFirst International Workshop, FETLT 2015, Seville, Spain, November 19-20, 2015, Revised Selected Papers
Number of pages12
ISBN (Electronic)978-3-319-33500-1
ISBN (Print)978-3-319-33499-8
Publication statusPublished - 26 Feb 2016
Event1st International Workshop on Future and Emergent Trends in Language Technology, FETLT 2015 - Seville, Spain
Duration: 19 Nov 201520 Nov 2015

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN (Print)03029743
ISSN (Electronic)16113349


Conference1st International Workshop on Future and Emergent Trends in Language Technology, FETLT 2015

Keywords / Materials (for Non-textual outputs)

  • Adaptation
  • Interlingual speech-to-speech translation
  • Repair strategies
  • Speaker alignment
  • User evaluation


Dive into the research topics of 'A speech-to-speech, machine translation mediated map task: An exploratory study'. Together they form a unique fingerprint.

Cite this