Can models of author intention support quality assessment of content?

A. J. Casey, Bonnie Webber, Dorota G. Lowacka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Academics seek to find, understand and critically review the work of other researchers through published scientific articles. In recent years, the volume of available information has significantly increased, partly due to technological advancements and partly due to pressures on academics to 'publish or perish'. This amount of papers presents a challenge not only for the peer-review process but also for readers, particularly inexperienced readers, to find publications of high quality. Whilst one might rely on citation or journal rankings to help guide this decision, this approach may not be completely reliable due to biased peer-review processes and the fact that the citation count of an article does not per se indicate its quality. Here, we analyse how expected author intentions in a Related Work section can be used to indicate its quality. We show that author intentions can predict the quality with reasonable accuracy and propose that similar approaches could be used in other sections to provide an overall picture of quality. This approach could be useful in supporting peer-review processes and for a reader in prioritising articles to read.

Original languageEnglish
Title of host publicationProceedings of the 4th Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries (BIRNDL 2019)
EditorsMuthu Kumar Chandrasekaran, Philipp Mayr
PublisherCEUR-WS
Pages92-99
Number of pages8
Volume2414
Publication statusPublished - 25 Jul 2019
Event4th Joint Workshop on Bibliometric-Enhanced Information Retrieval and Natural Language Processing for Digital Libraries, BIRNDL 2019 - Paris, France
Duration: 25 Jul 2019 → …

Publication series

Name
PublisherCEUR-WS
Volume2414
ISSN (Electronic)1613-0073

Conference

Conference4th Joint Workshop on Bibliometric-Enhanced Information Retrieval and Natural Language Processing for Digital Libraries, BIRNDL 2019
Country/TerritoryFrance
CityParis
Period25/07/19 → …

Keywords / Materials (for Non-textual outputs)

  • Article Quality
  • Author Intentions
  • Supporting peer-review

Fingerprint

Dive into the research topics of 'Can models of author intention support quality assessment of content?'. Together they form a unique fingerprint.

Cite this