TerrorCat: a Translation Error Categorization-based MT Quality Metric

Mark Fishel, Rico Sennrich, Maja Popovic, Ondrej Bojar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present TerrorCat, a submission to the WMT 12 metric sharedtask. TerrorCat uses frequencies of automatically obtained translation error categories as base for pairwise comparison of translation hypotheses, whichis in turn used to generate a score for every translation. The metric shows high overall correlation with human judgements on the system level and more modest results on the level of individual sentences.
Original languageEnglish
Title of host publicationProceedings of the Seventh Workshop on Statistical Machine Translation. Workshop on Statistical Machine Translation (WMT-12), located at NAACL, June 7-8, Montreal,, QC, Canada
PublisherAssociation for Computational Linguistics
Pages64-70
Number of pages7
Publication statusPublished - 1 Jun 2012
EventWorkshop on Statistical Machine Translation (WMT-12) - Montreal, Canada
Duration: 7 Jun 20128 Jun 2012

Workshop

WorkshopWorkshop on Statistical Machine Translation (WMT-12)
CountryCanada
CityMontreal
Period7/06/128/06/12

Cite this