Evaluating MT for massive open online courses

Sheila Castilho, Joss Moorkens, Federico Gaspari, Rico Sennrich, Andy Way, Panayota Georgakopoulou

Research output: Contribution to journalArticlepeer-review


This article reports a multifaceted comparison between statistical and neural machine translation (MT) systems that were developed for translation of data from massive open online courses (MOOCs). The study uses four language pairs: English to German, Greek, Portuguese, and Russian. Translation quality is evaluated using automatic metrics and human evaluation, carried out by professional translators. Results show that neural MT is preferred in side-by-side ranking, and is found to contain fewer overall errors. Results are less clear-cut for some error categories, and for temporal and technical post-editing effort. In addition, results are reported based on sentence length, showing advantages and disadvantages depending on the particular language pair and MT paradigm.
Original languageEnglish
Number of pages24
JournalMachine Translation
Early online date17 Aug 2018
Publication statusE-pub ahead of print - 17 Aug 2018


Dive into the research topics of 'Evaluating MT for massive open online courses'. Together they form a unique fingerprint.

Cite this