Connected Speech-Based Cognitive Assessment in Chinese and English

Saturnino Luz, Sofia De La Fuente Garcia, Fasih Haider, Davida Fromm, Brian MacWhinney, Alyssa Lanzi, Ya-Ning Chang, Chia-Ju Chou, Yi-Chien Liu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a novel benchmark dataset and prediction tasks for investigating approaches to assess cognitive function through analysis of connected speech. The dataset consists of speech samples and clinical information for speakers of Mandarin Chinese and English with different levels of cognitive impairment as well as individuals with normal cognition. These data have been carefully matched by age and sex by propensity score analysis to ensure balance and representativity in model training. The prediction tasks encompass mild cognitive impairment diagnosis and cognitive test score prediction. This framework was designed to encourage the development of approaches to speech-based cognitive assessment which generalise across languages. We illustrate it by presenting baseline prediction models that employ language-agnostic and comparable features for diagnosis and cognitive test score prediction. Unweighted average recall was 59.2% in diagnosis, and root mean squared error was 2.89 in score prediction.
Original languageEnglish
Title of host publicationProceedings of Interspeech 2024
PublisherISCA
Pages947-951
Number of pages5
DOIs
Publication statusPublished - 1 Sept 2024
EventThe 25th Interspeech Conference - Kipriotis International Convention Center, Kos Island, Greece
Duration: 1 Sept 20245 Sept 2024
Conference number: 25
https://interspeech2024.org/

Conference

ConferenceThe 25th Interspeech Conference
Abbreviated titleInterspeech 2024
Country/TerritoryGreece
CityKos Island
Period1/09/245/09/24
Internet address

Fingerprint

Dive into the research topics of 'Connected Speech-Based Cognitive Assessment in Chinese and English'. Together they form a unique fingerprint.

Cite this