TerrorCat: a Translation Error Categorization-based MT Quality Metric

Mark Fishel, Rico Sennrich, Maja Popovic, Ondrej Bojar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

We present TerrorCat, a submission to the WMT 12 metric sharedtask. TerrorCat uses frequencies of automatically obtained translation error categories as base for pairwise comparison of translation hypotheses, whichis in turn used to generate a score for every translation. The metric shows high overall correlation with human judgements on the system level and more modest results on the level of individual sentences.
Original languageEnglish
Title of host publicationProceedings of the Seventh Workshop on Statistical Machine Translation. Workshop on Statistical Machine Translation (WMT-12), located at NAACL, June 7-8, Montreal,, QC, Canada
PublisherAssociation for Computational Linguistics
Number of pages7
Publication statusPublished - 1 Jun 2012
EventWorkshop on Statistical Machine Translation (WMT-12) - Montreal, Canada
Duration: 7 Jun 20128 Jun 2012


WorkshopWorkshop on Statistical Machine Translation (WMT-12)


Dive into the research topics of 'TerrorCat: a Translation Error Categorization-based MT Quality Metric'. Together they form a unique fingerprint.

Cite this