BEER 1.1: ILLC UvA submission to metrics and tuning task

Milos Stanojevic, Khalil Sima'an

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We describe the submissions of ILLC UvA to the metrics and tuning tasks on WMT15. Both submissions are based on the BEER evaluation metric originally presented on WMT14 (Stanojevic´ and Sima’an, 2014a). The main changes introduced this year are: (i) extending the learning-to-rank trained sentence level metric to the corpus level (but still decomposable to sentence level), (ii) incorporating syntactic ingredients based on dependency trees, and (iii) a technique for finding parameters of BEER that avoid “gaming of the metric” during tuning.
Original languageEnglish
Title of host publicationProceedings of the Tenth Workshop on Statistical Machine Translation
Place of PublicationLisboa, Portugal
PublisherAssociation for Computational Linguistics (ACL)
Pages396-401
Number of pages6
DOIs
Publication statusPublished - Sep 2015
EventTenth Workshop on Statistical Machine Translation - Lisbon, Portugal
Duration: 17 Sep 201518 Sep 2015
http://www.statmt.org/wmt15/

Conference

ConferenceTenth Workshop on Statistical Machine Translation
Abbreviated titleEMNLP 2015
CountryPortugal
CityLisbon
Period17/09/1518/09/15
Internet address

Fingerprint

Dive into the research topics of 'BEER 1.1: ILLC UvA submission to metrics and tuning task'. Together they form a unique fingerprint.

Cite this