LSDSem 2017 Shared Task: The Story Cloze Test

Nasrin Mostafazadeh, Michael Roth, Annie Louis, Nathanael Chambers, James F. Allen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The LSDSem’17 shared task is the Story Cloze Test, a new evaluation for story understanding and script learning. This test provides a system with a four-sentence story and two possible endings, and the system must choose the correct ending to the story. Successful narrative understanding (getting closer to human performance of 100%) requires systems to link various levels of semantics to commonsense knowledge. A total of eight systems participated in the shared task, with a variety of approaches including end-to-end neural networks, feature-based regression models, and rule-based methods. The highest performing system achieves an accuracy of 75.2%, a substantial improvement over the previous state-of-the-art.
Original languageEnglish
Title of host publicationProceedings of the 2nd Workshop on Linking Models of Lexical, Sentential and Discourse-level Semantics
PublisherAssociation for Computational Linguistics
Pages46-51
Number of pages6
ISBN (Print)978-1-945626-40-1
DOIs
Publication statusPublished - 3 Apr 2017
Event2nd Workshop on Linking Models of Lexical, Sentential and Discourse-level Semantics - Valencia, Spain
Duration: 3 Apr 20173 Apr 2017
http://www.coli.uni-saarland.de/~mroth/LSDSem/

Conference

Conference2nd Workshop on Linking Models of Lexical, Sentential and Discourse-level Semantics
Abbreviated titleLSDSem 2017
CountrySpain
CityValencia
Period3/04/173/04/17
Internet address

Fingerprint

Dive into the research topics of 'LSDSem 2017 Shared Task: The Story Cloze Test'. Together they form a unique fingerprint.

Cite this