The role of prosody and gaze in turn-end anticipation

Chiara Gambi; Torsten Jachmann; Maria Staudte

The role of prosody and gaze in turn-end anticipation

Chiara Gambi, Torsten Jachmann, Maria Staudte

School of Philosophy, Psychology and Language Sciences

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

How do listeners integrate multiple sources of information in order to accurately anticipate turn endings? In two experiments using synthesised speech and a virtual agent we examined the role of verbal and gaze information in a turnend anticipation task. Listeners were as good at anticipating the synthesised voice as they were with human speakers (Experiment 1). However, the direction and timing of the agent’s gaze had little influence on their accuracy (Experiment 2). Overall, these findings support the idea that anticipation of turn ends relies primarily, but not exclusively, on verbal content.

Original language	English
Title of host publication	Proceedings of the 37th Annual Conference of the Cognitive Science Society
ISBN (Electronic)	978-0-9911967-2-2
Publication status	Published - 2015

Keywords

turn-taking
prediction
pitch
gaze
virtual agent

Access to Document

Turn-Taking_revision_final
© Gambi, C., Jachmann, T., & Staudte, M. (2015). The role of prosody and gaze in turn-end anticipation. In Proceedings of the Annual Conference of the Cognitive Science Society.
Accepted author manuscript, 477 KB

Fingerprint Dive into the research topics of 'The role of prosody and gaze in turn-end anticipation'. Together they form a unique fingerprint.

The role of prosody and gaze in turn-end anticipation
Gambi, C. (Creator), Jachmann, T. (Creator) & Staudte, M. (Creator), University of Edinburgh, 30 Apr 2015
DOI: 10.7488/ds/234
Dataset

Cite this

@inproceedings{918e69d4f36d417fbfcd5cf987f910ad,

title = "The role of prosody and gaze in turn-end anticipation",

abstract = "How do listeners integrate multiple sources of information in order to accurately anticipate turn endings? In two experiments using synthesised speech and a virtual agent we examined the role of verbal and gaze information in a turnend anticipation task. Listeners were as good at anticipating the synthesised voice as they were with human speakers (Experiment 1). However, the direction and timing of the agent{\textquoteright}s gaze had little influence on their accuracy (Experiment 2). Overall, these findings support the idea that anticipation of turn ends relies primarily, but not exclusively, on verbal content.",

keywords = "turn-taking, prediction, pitch, gaze, virtual agent",

author = "Chiara Gambi and Torsten Jachmann and Maria Staudte",

year = "2015",

language = "English",

booktitle = "Proceedings of the 37th Annual Conference of the Cognitive Science Society",

}

TY - GEN

T1 - The role of prosody and gaze in turn-end anticipation

AU - Gambi, Chiara

AU - Jachmann, Torsten

AU - Staudte, Maria

PY - 2015

Y1 - 2015

N2 - How do listeners integrate multiple sources of information in order to accurately anticipate turn endings? In two experiments using synthesised speech and a virtual agent we examined the role of verbal and gaze information in a turnend anticipation task. Listeners were as good at anticipating the synthesised voice as they were with human speakers (Experiment 1). However, the direction and timing of the agent’s gaze had little influence on their accuracy (Experiment 2). Overall, these findings support the idea that anticipation of turn ends relies primarily, but not exclusively, on verbal content.

AB - How do listeners integrate multiple sources of information in order to accurately anticipate turn endings? In two experiments using synthesised speech and a virtual agent we examined the role of verbal and gaze information in a turnend anticipation task. Listeners were as good at anticipating the synthesised voice as they were with human speakers (Experiment 1). However, the direction and timing of the agent’s gaze had little influence on their accuracy (Experiment 2). Overall, these findings support the idea that anticipation of turn ends relies primarily, but not exclusively, on verbal content.

KW - turn-taking

KW - prediction

KW - pitch

KW - gaze

KW - virtual agent

UR - https://mindmodeling.org/cogsci2015/

M3 - Conference contribution

BT - Proceedings of the 37th Annual Conference of the Cognitive Science Society

ER -