Start making sense: Identifying behavioural indicators when things go wrong during interaction with artificial agents

Sara Dalzel-Job*, Robin Hill, Ron Petrick

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

This project looks at how people approach collaborative interactions with humans and virtual humans, particularly when encountering ambiguous or unexpected situations. The aim is to create natural and accurate models of users’ behaviours, incorporating social signals and indicators of psychological and physiological states (such as eye movements, galvanic skin response, facial expression and subjective perceptions of an interlocutor) under different conditions, with varying patterns of feedback. The findings from this study will allow artificial agents to be trained to understand characteristic human behaviour exhibited during communication, and how to respond to specific non-verbal cues and biometric feedback with appropriately human-like behaviour. Continuous monitoring of “success” during communication, rather than simply at the end, allows for a more fluid and agile interaction, ultimately reducing the likelihood of critical failure.
Original languageEnglish
Title of host publicationPRIMA 2022
Subtitle of host publicationPrinciples and Practice of Multi-Agent Systems - 24th International Conference, Proceedings
EditorsReyhan Aydoğan, Natalia Criado, Victor Sanchez-Anguix, Jérôme Lang, Marc Serramia
PublisherSpringer-Verlag
Pages582-591
Number of pages10
ISBN (Print)9783031212024
DOIs
Publication statusPublished - 16 Nov 2022
Event24th International Conference on Principles and Practice of Multi-Agent Systems, PRIMA 2020 - Valencia , Spain
Duration: 16 Nov 202218 Nov 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13753 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference24th International Conference on Principles and Practice of Multi-Agent Systems, PRIMA 2020
Country/TerritorySpain
CityValencia
Period16/11/2218/11/22

Keywords / Materials (for Non-textual outputs)

  • AIs
  • biometrics
  • eye tracking
  • facial expression
  • GSR
  • social interaction
  • task-focused interaction
  • trust
  • virtual humans

Fingerprint

Dive into the research topics of 'Start making sense: Identifying behavioural indicators when things go wrong during interaction with artificial agents'. Together they form a unique fingerprint.

Cite this