I Feel You: The Design and Evaluation of a Domotic Affect-Sensitive Spoken Conversational Agent

Syaheerah Lebai Lutfi, Fernando Fernandez-Martinez, Jaime Lorenzo-Trueba, Roberto Barra-Chicote, Juan Manuel Montero

Research output: Contribution to journalArticlepeer-review

Abstract

We describe the work on infusion of emotion into a limited-task autonomous spoken conversational agent situated in the domestic environment, using a need-inspired task-independent emotion model (NEMO). In order to demonstrate the generation of affect through the use of the model, we describe the work of integrating it with a natural-language mixed-initiative HiFi-control spoken conversational agent (SCA). NEMO and the host system communicate externally, removing the need for the Dialog Manager to be modified, as is done in most existing dialog systems, in order to be adaptive. The first part of the paper concerns the integration between NEMO and the host agent. The second part summarizes the work on automatic affect prediction, namely, frustration and contentment, from dialog features, a non-conventional source, in the attempt of moving towards a more user-centric approach. The final part reports the evaluation results obtained from a user study, in which both versions of the agent (non-adaptive and emotionally-adaptive) were compared. The results provide substantial evidences with respect to the benefits of adding emotion in a spoken conversational agent, especially in mitigating users’ frustrations and, ultimately, improving their satisfaction.
Original languageEnglish
Pages (from-to)10519-10538
Number of pages20
JournalSensors
Volume13
Issue number8
DOIs
Publication statusPublished - 2013

Fingerprint

Dive into the research topics of 'I Feel You: The Design and Evaluation of a Domotic Affect-Sensitive Spoken Conversational Agent'. Together they form a unique fingerprint.

Cite this