Volleyball Action Modelling for Behavior Analysis and Interactive Multi-modal Feedback

Fahim A Salim, Fasih Haider, Sena Busra Yengec Tasdemir, Vahid Naghashi, Izem Tengiz, Kubra Cengiz, Dees B.W. Postma, Robby Van Delden, Dennis Reidsma, Saturnino Luz, Bert Jan Van Beijnum

Research output: Chapter in Book/Report/Conference proceedingChapter (peer-reviewed)peer-review

Abstract

Quick and easy access to performance data during matches and training sessions is important for both players and coaches. While there are many video tagging systems available, these systems require manual efforts. In this project, we use Inertial Measurement Units (IMU) sensors strapped on the wrists of volleyball players to capture motion data and use Machine Learning techniques to model their actions and non-actions events during matches and training sessions.
Analysis of the results suggests that all sensors in the IMU (i.e. magnetometer, accelerometer, barometer and gyroscope) contribute unique information in the classification of volleyball-specific actions. We demonstrate that while the accelerometer feature set provides the best Unweighted Average Recall (UAR) overall, decision fusion of the accelerometer with the magnetometer improves UAR slightly from 85.86\% to 86.9\%. Interestingly, it is also demonstrated that the non-dominant hand provides better UAR than the dominant hand. These results are even more marked with decision fusion.
Apart from machine learning models, the project proposes a modular architecture for a system to automatically supplement video recording by detecting events of interests in volleyball matches and training sessions and to provide tailored and interactive multi-modal feedback by utilizing an html5/JavaScript application. A proof of concept prototype is also developed based on this architecture.
Original languageEnglish
Title of host publication15th International Summer Workshop on Multimodal Interfaces
Subtitle of host publicationProceedings eNTERFACE’19
EditorsHamdi Dibeklioğlu, Elif Sürer
Place of PublicationAnkara
PublisherComputer Engineering Department, Bilkent University, Ankara, Turkey
Pages50-58
Number of pages9
ISBN (Electronic)978-605-9788-33-5
Publication statusPublished - 1 Jan 2020
EventeNTERFACE'19: 15th International Summer Workshop on Multimodal Interfaces - Bilkent University, Ankara, Turkey
Duration: 8 Jul 20192 Aug 2019

Conference

ConferenceeNTERFACE'19: 15th International Summer Workshop on Multimodal Interfaces
Country/TerritoryTurkey
CityAnkara
Period8/07/192/08/19

Fingerprint

Dive into the research topics of 'Volleyball Action Modelling for Behavior Analysis and Interactive Multi-modal Feedback'. Together they form a unique fingerprint.

Cite this