Improving Meeting Summarization by Focusing on User Needs: A Task-Oriented Evaluation

Johanna D. Moore, Pei-Yun Hsueh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Advances in multimedia technologies have enabled the creation of huge archives of audio-video recordings of meetings, and there is burgeoning interest in developing meeting browsers to help users better leverage these archives. A recent study has shown that extractive summaries provide a more efficient way of navigating meeting content than simply reading through the transcript and using the audio-video record, or navigating via keyword search (Murray, 2007). The extractive summary technique identifies informative dialogue acts to generate general purpose summaries. These summaries can still be lengthy. Recently, we have developed a decision-focused summarization system that presents only 1-2% of the recordings related to decision making. In this paper, we describe a task-based evaluation in which we compare the decision-focused summaries to the general purpose summaries. Our results indicate that the more focused summaries help users perform the decision debriefing task more effectively and improve perceived efficiency. In addition, this study also investigates the effect of automatic summaries and transcription on task effectiveness, report quality, and users' perceptions of task success.
Original languageEnglish
Title of host publicationProceedings of the 14th International Conference on Intelligent User Interfaces
PublisherACM
Pages17-26
Number of pages10
ISBN (Print)978-1-60558-168-2
DOIs
Publication statusPublished - 2009

Keywords

  • automatic summarization
  • meeting browser
  • multimedia information retrieval
  • task-oriented evaluation
  • user study

Fingerprint Dive into the research topics of 'Improving Meeting Summarization by Focusing on User Needs: A Task-Oriented Evaluation'. Together they form a unique fingerprint.

Cite this