Talking to a system and oneself: A study from a speech-to-speech, machine translation mediated map task

Hayakawa Akira; Fasih Haider; Saturnino Luz; Loredana Cerrato; Nick Campbell

doi:10.21437/SpeechProsody.2016-159

Talking to a system and oneself: A study from a speech-to-speech, machine translation mediated map task

Hayakawa Akira
, Fasih Haider
, Saturnino Luz
, Loredana Cerrato
, Nick Campbell

Research output: Contribution to conference › Paper › peer-review

Abstract

The results of a comparison between three different speech types—On-Talk, speaking to a computer, Off-Talk Self, speaking to oneself and Off-Talk Other, speaking to another person — uttered by subjects in a collaborative interlingual task mediated by an automatic speech-to-speech translation system, are reported here. The characteristics of the three speech types show significant differences in terms of speech rate (F_2,2719 = 101.7; p <2e − 16), and for this reason a detection method was implemented to see if they could also be detected with good accuracy based on their acoustic and biological characteristics. Acoustic and biological measures provide good results in distinguish between On-Talk and Off-Talk, but have difficulty distinguishing the sub-criteria of Off-Talk: Self and Other.

Original language	English
Pages	776-780
Number of pages	5
DOIs	https://doi.org/10.21437/SpeechProsody.2016-159
Publication status	Published - 2016
Event	Speech Prosody 2016 - Boston, United States Duration: 31 May 2016 → 3 Jun 2016 http://sites.bu.edu/speechprosody2016/

Conference

Conference	Speech Prosody 2016
Country/Territory	United States
City	Boston
Period	31/05/16 → 3/06/16
Internet address	http://sites.bu.edu/speechprosody2016/

Keywords / Materials (for Non-textual outputs)

Computational paralinguistics
Human-computer interaction
Speech recognition

Access to Document

10.21437/SpeechProsody.2016-159

http://www.isca-speech.org/archive/SpeechProsody_2016/pdfs/136.pdf

Cite this

@conference{021e713d4e504c61b90459f69c48193f,

title = "Talking to a system and oneself: A study from a speech-to-speech, machine translation mediated map task",

abstract = "The results of a comparison between three different speech types—On-Talk, speaking to a computer, Off-Talk Self, speaking to oneself and Off-Talk Other, speaking to another person — uttered by subjects in a collaborative interlingual task mediated by an automatic speech-to-speech translation system, are reported here. The characteristics of the three speech types show significant differences in terms of speech rate (F2,2719 = 101.7; p <2e − 16), and for this reason a detection method was implemented to see if they could also be detected with good accuracy based on their acoustic and biological characteristics. Acoustic and biological measures provide good results in distinguish between On-Talk and Off-Talk, but have difficulty distinguishing the sub-criteria of Off-Talk: Self and Other.",

keywords = "Computational paralinguistics, Human-computer interaction, Speech recognition",

author = "Hayakawa Akira and Fasih Haider and Saturnino Luz and Loredana Cerrato and Nick Campbell",

year = "2016",

doi = "10.21437/SpeechProsody.2016-159",

language = "English",

pages = "776--780",

note = "Speech Prosody 2016 ; Conference date: 31-05-2016 Through 03-06-2016",

url = "http://sites.bu.edu/speechprosody2016/",

}

TY - CONF

T1 - Talking to a system and oneself

T2 - Speech Prosody 2016

AU - Akira, Hayakawa

AU - Haider, Fasih

AU - Luz, Saturnino

AU - Cerrato, Loredana

AU - Campbell, Nick

PY - 2016

Y1 - 2016

N2 - The results of a comparison between three different speech types—On-Talk, speaking to a computer, Off-Talk Self, speaking to oneself and Off-Talk Other, speaking to another person — uttered by subjects in a collaborative interlingual task mediated by an automatic speech-to-speech translation system, are reported here. The characteristics of the three speech types show significant differences in terms of speech rate (F2,2719 = 101.7; p <2e − 16), and for this reason a detection method was implemented to see if they could also be detected with good accuracy based on their acoustic and biological characteristics. Acoustic and biological measures provide good results in distinguish between On-Talk and Off-Talk, but have difficulty distinguishing the sub-criteria of Off-Talk: Self and Other.

AB - The results of a comparison between three different speech types—On-Talk, speaking to a computer, Off-Talk Self, speaking to oneself and Off-Talk Other, speaking to another person — uttered by subjects in a collaborative interlingual task mediated by an automatic speech-to-speech translation system, are reported here. The characteristics of the three speech types show significant differences in terms of speech rate (F2,2719 = 101.7; p <2e − 16), and for this reason a detection method was implemented to see if they could also be detected with good accuracy based on their acoustic and biological characteristics. Acoustic and biological measures provide good results in distinguish between On-Talk and Off-Talk, but have difficulty distinguishing the sub-criteria of Off-Talk: Self and Other.

KW - Computational paralinguistics

KW - Human-computer interaction

KW - Speech recognition

UR - https://www.scopus.com/pages/publications/84982972445

U2 - 10.21437/SpeechProsody.2016-159

DO - 10.21437/SpeechProsody.2016-159

M3 - Paper

AN - SCOPUS:84982972445

SP - 776

EP - 780

Y2 - 31 May 2016 through 3 June 2016

ER -

Talking to a system and oneself: A study from a speech-to-speech, machine translation mediated map task

Abstract

Conference

Keywords / Materials (for Non-textual outputs)

Access to Document

Other files and links

Fingerprint

Cite this