Towards a Semantic Model for Textual Entailment Annotation

Assaf Toledo, Stavroula Alexandropoulou, Sophie Chesney, Sophia Katrenko, Heidi Klockmann, Heidi Klockmann, Wen Kokke, Benno Kruit, Yoad Winter

Research output: Contribution to journalArticlepeer-review

Abstract

We introduce a new formal semantic model for annotating textual entailments that describes restrictive, intersective, and appositive modification. The model contains a formally defined interpreted lexicon, which specifies the inventory of symbols and the supported semantic operators, and an informally defined annotation scheme that instructs annotators in which way to bind words and constructions from a given pair of premise and hypothesis to the interpreted lexicon. We explore the applicability of the proposed model to the Recognizing Textual Entailment (RTE) 1–4 corpora and describe a first-stage annotation scheme on which we based the manual annotation work. The constructions we annotated were found to occur in 80.65% of the entailments in RTE 1–4 and were annotated with cross-annotator agreement of 68% on average. The annotated parts of the RTE corpora are publicly available for further research.
Original languageEnglish
Pages (from-to)117-150
Number of pages34
JournalLinguistic Issues in Language Technology
Volume9
Publication statusPublished - 2014
Externally publishedYes

Fingerprint

Dive into the research topics of 'Towards a Semantic Model for Textual Entailment Annotation'. Together they form a unique fingerprint.

Cite this