Cusco: An Unobtrusive Custom Secure Audio-Visual Recording System for Ambient Assisted Living

Pierre Albert, Fasih Haider*, Saturnino Luz

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract / Description of output

The ubiquity of digital technology has facilitated detailed recording of human behaviour. Ambient technology has been used to capture behaviours in a broad range of applications ranging from healthcare and monitoring to assessment of cooperative work. However, existing systems often face challenges in terms of autonomy, usability, and privacy. This paper presents a portable, easy-to-use and privacy-preserving system for capturing behavioural signals unobtrusively in home or in office settings. The system focuses on the capture of audio, video, and depth imaging. It is based on a device built on a small-factor platform that incorporates ambient sensors which can be integrated with the audio and depth video hardware for multimodal behaviour tracking. The system can be accessed remotely and integrated into a network of sensors. Data are encrypted in real time to ensure safety and privacy. We illustrate uses of the device in two different settings, namely, a healthy-ageing IoT application, where the device is used in conjunction with a range of IoT sensors to monitor an older person's mental well-being at home, and a healthcare communication quality assessment application, where the device is used to capture a patient-clinician interaction for consultation quality appraisal. CUSCO can automatically detect active speakers, extract acoustic features, record video and depth streams, and recognise emotions and cognitive impairment with promising accuracy.

Original languageEnglish
Article number1506
Number of pages21
Issue number5
Publication statusPublished - 26 Feb 2024

Keywords / Materials (for Non-textual outputs)

  • Humans
  • Aged
  • Ambient Intelligence
  • Delivery of Health Care/methods
  • Privacy
  • Emotions
  • Culture


Dive into the research topics of 'Cusco: An Unobtrusive Custom Secure Audio-Visual Recording System for Ambient Assisted Living'. Together they form a unique fingerprint.

Cite this