Semantic annotation of textual entailment

Assaf Toledo; Stavroula Alexandropoulou; Sophia Katrenko; Heidi Klockmann; Wen Kokke; Yoad Winter

Semantic annotation of textual entailment

Assaf Toledo
, Stavroula Alexandropoulou
, Sophia Katrenko
, Heidi Klockmann
, Wen Kokke
, Yoad Winter

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We introduce a new formal semantic model for annotating textual entailments, that describes restrictive, intersective and appositive modification. The model contains a formally defined interpreted lexicon, which specifies the inventory of symbols and the supported semantic operators, and an informally defined annotation scheme that instructs annotators in which way to bind words and constructions from a given pair of premise and hypothesis to the interpreted lexicon. We explore the applicability of the proposed model to the Recognizing Textual Entailment (RTE) 1-4 corpora and describe a first-stage annotation scheme based on which manual annotation work was carried out. The constructions we annotated were found to occur in 80.65% of the entailments in RTE 1-4 and were annotated with cross-annotator agreement of 68% on average. The annotated RTE corpora are publicly available for the research community.

Original language	English
Title of host publication	Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013) – Long Papers
Editors	Alexander Koller, Katrin Erk
Publisher	ASSOC COMPUTATIONAL LINGUISTICS-ACL
Pages	240--251
Number of pages	11
Publication status	Published - 4 Apr 2013
Externally published	Yes
Event	10th International Conference on Computational Semantics - University of Postdam, Potsdam, Germany Duration: 19 Mar 2013 → 22 Mar 2013 http://www.ling.uni-potsdam.de/iwcs2013/

Conference

Conference	10th International Conference on Computational Semantics
Abbreviated title	IWCS 2013
Country/Territory	Germany
City	Potsdam
Period	19/03/13 → 22/03/13
Internet address	http://www.ling.uni-potsdam.de/iwcs2013/

Access to Document

Semantic Annotation_TOLEDO_DoA100113_AFVAccepted author manuscript, 237 KBLicence: Creative Commons: Attribution (CC-BY)

https://www.aclweb.org/anthology/volumes/W13-01/

Cite this

Toledo, A., Alexandropoulou, S., Katrenko, S., Klockmann, H., Kokke, W., & Winter, Y. (2013). Semantic annotation of textual entailment. In A. Koller, & K. Erk (Eds.), Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013) – Long Papers (pp. 240--251). ASSOC COMPUTATIONAL LINGUISTICS-ACL. https://www.aclweb.org/anthology/volumes/W13-01/

@inproceedings{a14970eb8b9e439b9ead3c267249787c,

title = "Semantic annotation of textual entailment",

abstract = "We introduce a new formal semantic model for annotating textual entailments, that describes restrictive, intersective and appositive modification. The model contains a formally defined interpreted lexicon, which specifies the inventory of symbols and the supported semantic operators, and an informally defined annotation scheme that instructs annotators in which way to bind words and constructions from a given pair of premise and hypothesis to the interpreted lexicon. We explore the applicability of the proposed model to the Recognizing Textual Entailment (RTE) 1-4 corpora and describe a first-stage annotation scheme based on which manual annotation work was carried out. The constructions we annotated were found to occur in 80.65\% of the entailments in RTE 1-4 and were annotated with cross-annotator agreement of 68\% on average. The annotated RTE corpora are publicly available for the research community.",

author = "Assaf Toledo and Stavroula Alexandropoulou and Sophia Katrenko and Heidi Klockmann and Wen Kokke and Yoad Winter",

year = "2013",

month = apr,

day = "4",

language = "English",

pages = "240----251",

editor = "Alexander Koller and Katrin Erk",

booktitle = "Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013) – Long Papers",

publisher = "ASSOC COMPUTATIONAL LINGUISTICS-ACL",

note = "10th International Conference on Computational Semantics, IWCS 2013 ; Conference date: 19-03-2013 Through 22-03-2013",

url = "http://www.ling.uni-potsdam.de/iwcs2013/",

}

Toledo, A, Alexandropoulou, S, Katrenko, S, Klockmann, H, Kokke, W & Winter, Y 2013, Semantic annotation of textual entailment. in A Koller & K Erk (eds), Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013) – Long Papers. ASSOC COMPUTATIONAL LINGUISTICS-ACL, pp. 240--251, 10th International Conference on Computational Semantics, Potsdam, Germany, 19/03/13. <https://www.aclweb.org/anthology/volumes/W13-01/>

Semantic annotation of textual entailment. / Toledo, Assaf; Alexandropoulou, Stavroula; Katrenko, Sophia et al.
Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013) – Long Papers. ed. / Alexander Koller; Katrin Erk. ASSOC COMPUTATIONAL LINGUISTICS-ACL, 2013. p. 240--251.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Semantic annotation of textual entailment

AU - Toledo, Assaf

AU - Alexandropoulou, Stavroula

AU - Katrenko, Sophia

AU - Klockmann, Heidi

AU - Kokke, Wen

AU - Winter, Yoad

PY - 2013/4/4

Y1 - 2013/4/4

N2 - We introduce a new formal semantic model for annotating textual entailments, that describes restrictive, intersective and appositive modification. The model contains a formally defined interpreted lexicon, which specifies the inventory of symbols and the supported semantic operators, and an informally defined annotation scheme that instructs annotators in which way to bind words and constructions from a given pair of premise and hypothesis to the interpreted lexicon. We explore the applicability of the proposed model to the Recognizing Textual Entailment (RTE) 1-4 corpora and describe a first-stage annotation scheme based on which manual annotation work was carried out. The constructions we annotated were found to occur in 80.65% of the entailments in RTE 1-4 and were annotated with cross-annotator agreement of 68% on average. The annotated RTE corpora are publicly available for the research community.

AB - We introduce a new formal semantic model for annotating textual entailments, that describes restrictive, intersective and appositive modification. The model contains a formally defined interpreted lexicon, which specifies the inventory of symbols and the supported semantic operators, and an informally defined annotation scheme that instructs annotators in which way to bind words and constructions from a given pair of premise and hypothesis to the interpreted lexicon. We explore the applicability of the proposed model to the Recognizing Textual Entailment (RTE) 1-4 corpora and describe a first-stage annotation scheme based on which manual annotation work was carried out. The constructions we annotated were found to occur in 80.65% of the entailments in RTE 1-4 and were annotated with cross-annotator agreement of 68% on average. The annotated RTE corpora are publicly available for the research community.

UR - https://www.scopus.com/pages/publications/85036474321

M3 - Conference contribution

AN - SCOPUS:85036474321

SP - 240

EP - 251

BT - Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013) – Long Papers

A2 - Koller, Alexander

A2 - Erk, Katrin

PB - ASSOC COMPUTATIONAL LINGUISTICS-ACL

T2 - 10th International Conference on Computational Semantics

Y2 - 19 March 2013 through 22 March 2013

ER -

Semantic annotation of textual entailment

Abstract

Conference

Access to Document

Other files and links

Fingerprint

Cite this