Evaluating the Effectiveness of Information Presentation in a Full End-To-End Dialogue System

Johanna D. Moore, Taghi Paksima, Kallirroi Georgila

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recent work on information presentation in dialogue systems combines user modelling (UM) and stepwise refinement through clustering and summarisation (SR) in the UMSR approach. An evaluation in which participants rated dialogue transcripts showed that UMSR presents complex trade-offs understandably, provides users with a good overview of their options, and increases users’ confidence that all relevant options have been presented (Demberg and Moore, 2006). In this paper, we evaluate the effectiveness of the UMSR approach in a more realistic setting, by incorporating this information presentation technique into a full endto- end dialogue system in the city information domain, and comparing it with the traditional approach of presenting information sequentially. Our results suggest that despite complications associated with a real dialogue system setting, the UMSR model retains its advantages.
Original languageEnglish
Title of host publicationProceedings 10th Annual Meeting of the ACL Special Interest Group on Discourse and Dialogue (SIGDIAL) 2009
PublisherAssociation for Computational Linguistics
Pages10
Number of pages10
ISBN (Print)978-1-932432-64-0
Publication statusPublished - 2009

Cite this