CCGbank: A Corpus of CCG Derivations and Dependency Structures Extracted from the Penn Treebank

Julia Hockenmaier, Mark Steedman

Research output: Contribution to journalArticlepeer-review

Abstract

This article presents an algorithm for translating the Penn Treebank into a corpus of Combinatory Categorial Grammar (CCG) derivations augmented with local and long-range word-word dependencies. The resulting corpus, CCGbank, includes 99.4% of the sentences in the Penn Treebank. It is available from the Linguistic Data Consortium, and has been used to train wide-coverage statistical parsers that obtain state-of-the-art rates of dependency recovery.
In order to obtain linguistically adequate CCG analyses, and to eliminate noise and inconsistencies in the original annotation, an extensive analysis of the constructions and annotations in the Penn Treebank was called for, and a substantial number of changes to the Treebank were necessary. We discuss the implications of our findings for the extraction of other linguistically expressive grammars from the Treebank, and for the design of future treebanks.
Original languageEnglish
Pages (from-to)355-396
Number of pages42
JournalComputational Linguistics
Volume33
Issue number3
DOIs
Publication statusPublished - 2007

Fingerprint

Dive into the research topics of 'CCGbank: A Corpus of CCG Derivations and Dependency Structures Extracted from the Penn Treebank'. Together they form a unique fingerprint.

Cite this