Shared periodic performer movements coordinate interactions in duo improvisations

Tuomas Eerola, Kelly Jakubowski, Nicola Moran, Peter E. Keller, Martin Clayton

Research output: Contribution to journalArticlepeer-review

Abstract

Human interaction involves the exchange of temporally coordinated, multimodal cues. Our work focused on interaction in the visual domain, using music performance as a case for analysis due to its temporally diverse and hierarchical structures. We made use of two improvising duo datasets—1) performances of a jazz standard with a regular pulse and 2) non-pulsed, free improvisations—to investigate whether human judgements of moments of interaction between co-performers are influenced by body movement coordination at multiple timescales. Bouts of interaction in the performances were manually annotated by experts and the performers’ movements were quantified using computer vision techniques. The annotated interaction bouts were then predicted using several quantitative movement and audio features. Over 80% of the interaction bouts were successfully predicted by a broadband measure of the energy of the cross-wavelet transform of the co-performers’ movements in non-pulsed duos. A more complex model, with multiple predictors that captured more specific, interacting features of the movements, was needed to explain a significant amount of variance in the pulsed duos. The methods developed here have key implications for future work on measuring visual coordination in musical ensemble performances, and can be easily adapted to other musical contexts, ensemble types, and traditions.
Original languageEnglish
Article number171520
JournalRoyal Society Open Science
Volume5
Issue number2
Early online date21 Feb 2018
DOIs
Publication statusPublished - 28 Feb 2019

Keywords

  • entrainment
  • music
  • interaction
  • coordination
  • duos
  • performance
  • wavelet
  • joint action

Fingerprint Dive into the research topics of 'Shared periodic performer movements coordinate interactions in duo improvisations'. Together they form a unique fingerprint.

Cite this