Building a Domain-specific Document Collection for Evaluating Metadata Effects on Information Retrieval

Walid Magdy, Jinming Min, Johannes Leveling, Gareth J. F. Jones

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper describes the development of a structured document collection containing user-generated text and numerical metadata for exploring the exploitation of metadata in information retrieval (IR). The collection consists of more than 61,000 documents extracted from YouTube video pages on basketball in general and NBA (National Basketball Association) in particular, together with a set of 40 topics and their relevance judgements. In addition, a collection of nearly 250,000 user profiles related to the NBA collection is available. Several baseline IR experiments report the effect of using video-associated metadata on retrieval effectiveness. The results surprisingly show that searching the videos titles only performs significantly better than searching additional metadata text fields of the videos such as the tags or the description.
Original languageEnglish
Title of host publicationProceedings of the International Conference on Language Resources and Evaluation, LREC 2010, 17-23 May 2010, Valletta, Malta
PublisherEuropean Language Resources Association (ELRA)
Pages1368-1375
Number of pages6
ISBN (Print)2-9517408-6-7
Publication statusPublished - May 2010

Fingerprint Dive into the research topics of 'Building a Domain-specific Document Collection for Evaluating Metadata Effects on Information Retrieval'. Together they form a unique fingerprint.

Cite this