Predicting cognitive load levels from speech data

Jing Su, Saturnino Luz*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract / Description of output

An analysis of acoustic features for a ternary cognitive load classification task and an application of a classification boosting method to the same task are presented. The analysis is based on a data set that encompasses a rich array of acoustic features as well as electroglottographic (EGG) data. Supervised and unsupervised methods for identifying constitutive features of the data set are investigated with the ultimate goal of improving prediction. Our experiments show that the different tasks used to elicit the speech for this challenge affect the acoustic features differently in terms of their predictive power and that different feature selection methods might be necessary across these sub-tasks. The sizes of the training sets are also an important factor, as evidenced by the fact that the use of boosting combined with feature selection was enough to bring the unweighted recall scores for the Stroop tasks well above a strong support vector machine baseline.

Original languageEnglish
Title of host publicationRecent Advances in Nonlinear Speech Processing
Number of pages9
ISBN (Electronic)978-3-319-28109-4
ISBN (Print)978-3-319-28107-0
Publication statusPublished - 23 Jan 2016

Keywords / Materials (for Non-textual outputs)

  • Classification
  • Cognitive load modeling
  • Feature selection
  • Paralinguistic information


Dive into the research topics of 'Predicting cognitive load levels from speech data'. Together they form a unique fingerprint.

Cite this