First time encounters with Roberta: a humanoid assistant for conversational autobiography creation

Minha Lee, S Schlogl, Seth Montenegro, Asier López, TN Trong, JM Olaso, F Haider, G Chollet, K Jokinen, D Petrovska-Delacretaz, H. Sansen, M.I. Torres

Research output: Contribution to conferencePaper

Abstract / Description of output

During eNTERFACE we developed a dialog system design and conversation material for Roberta, an anthropomorphic assistant robot. The focus was on the first stage of what we call LifeLine dialogs, i.e. the conversational creation of users’ life stories. Our goal is to help senior citizens record semiautobiographical narratives while combating the deterioration of memory and speech abilities. We successfully completed modelling dialog scenarios for first time users. This allows Roberta to personalize future conversations based on each user’s place of origin, work and education history, and hobbies, which are all information gathered during a user’s first conversation with Roberta. We accomplished this through (1) an adaptable dialog system with topic management and multi-modal functionalities (specifically face recognition), by extending a RavenClaw-type dialog management framework, (2) using the Wizard of Oz (WOZ) data collection technique for categorizing introductory conversation material and identifying semantic rules and concepts, and (3) simulating the customization of a user’s relationship with Roberta by introducing wizard-controlled contextual data, conversation history, and emotion awareness.
Original languageEnglish
Pages30-38
Number of pages9
Publication statusPublished - 2017
EventeNTERFACE’16 – 12th Summer Workshop on Multimodal Interfaces - University of Twente, Enschede, Netherlands
Duration: 18 Jul 201616 Aug 2016

Conference

ConferenceeNTERFACE’16 – 12th Summer Workshop on Multimodal Interfaces
Country/TerritoryNetherlands
CityEnschede
Period18/07/1616/08/16

Fingerprint

Dive into the research topics of 'First time encounters with Roberta: a humanoid assistant for conversational autobiography creation'. Together they form a unique fingerprint.

Cite this