Multi-document Topic Segmentation

Minwoo Jeong, Ivan Titov

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

Multiple documents describing the same or closely related sets of events are common and often easy to obtain: for example, consider document clusters on a news aggregator site or multiple reviews of the same product or service. Even though each such document discusses a similar set of topics, they provide alternative views or complimentary information on each of these topics. We argue that revealing hidden relations by jointly segmenting the documents, or, equivalently, predicting links between topically related segments in different documents would help to visualize documents of interest and construct friendlier user interfaces. In this paper, we refer to this problem as multi-document topic segmentation. We propose an unsupervised Bayesian model for the considered problem that models both shared and document-specific topics, and utilizes Dirichlet process priors to determine the effective number of topics. We show that topic segmentation can be inferred efficiently using a simple split-merge sampling algorithm. The resulting method outperforms baseline models on four datasets for multi-document topic segmentation.
Original languageEnglish
Title of host publicationProceedings of the 19th ACM International Conference on Information and Knowledge Management
Place of PublicationNew York, NY, USA
PublisherACM
Pages1119-1128
Number of pages10
ISBN (Print)978-1-4503-0099-5
DOIs
Publication statusPublished - 2010

Publication series

NameCIKM '10
PublisherACM

Fingerprint

Dive into the research topics of 'Multi-document Topic Segmentation'. Together they form a unique fingerprint.

Cite this