Exploring gesture sonification to support reflective craft practice

Thomas Smith, Simon J. Bowen, Bettina Nissen, Jonathan Hook, Arno Verhoeven, John Bowers, Peter Wright, Patrick Olivier

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

Much of the knowing employed in skilled craft practice is difficult to communicate solely through written or verbal description. Consequently, the reflection and development of a craft practice in this manner may miss important nuances of practitioners' skills and experiences. We created digital technologies to sonify (using audio to perceptualize data) a group of craft practitioners' gestures to explore how we can aid their reflection in and on their craft, and consequently develop it. Over a number of workshops, the design of these sonifications were iterated based on how the practitioners responded to them. We found that direct sonification of gesture (sounds generated directly from motion sensor data) helped practitioners understand and reflect upon their own and each other's practice, encouraged discussion and enabled modification of craft technique.
Original languageEnglish
Title of host publicationCHI '15
Subtitle of host publicationProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
PublisherACM
Pages67-76
Number of pages10
ISBN (Print)9781450331456
DOIs
Publication statusPublished - 18 Apr 2015

Fingerprint

Dive into the research topics of 'Exploring gesture sonification to support reflective craft practice'. Together they form a unique fingerprint.

Cite this