Findings of the WMT 2019 Biomedical Translation Shared Task: Evaluation for MEDLINE Abstracts and Biomedical Terminologies

Rachel Bawden, Kevin Bretonnel Cohen, Cristian Grozea, Antonio Jimeno Yepes, Madeleine Kittner, Martin Krallinger, Nancy Mah, Aurélie Névéol, Mariana Neves, Felipe Soares, Amy Siu, Karin Verspoor, Maika Vicente Navarro

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In the fourth edition of the WMT Biomedical Translation task, we considered a total of six languages, namely Chinese (zh), English (en), French (fr), German (de), Portuguese (pt), and Spanish (es). We performed an evaluation of automatic translations for a total of 10 language directions, namely, zh/en, en/zh, fr/en, en/fr, de/en, en/de, pt/en, en/pt, es/en, and en/es. We provided training data based on MEDLINE abstracts for eight of the 10 language pairs and test sets for all of them. In addition to that, we offered a new sub-task for the translation of terms in biomedical terminologies for the en/es language direction. Higher BLEU scores (close to 0.5) were obtained for the es/en, en/es and en/pt test sets, as well as for the terminology sub-task. After manual validation of the primary runs, some submissions were judged to be better than the reference translations, for instance, for de/en, en/es and es/en.
Original languageEnglish
Title of host publicationProceedings of the Fourth Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2)
PublisherAssociation for Computational Linguistics
Pages29-53
Number of pages25
Publication statusPublished - 2 Aug 2019
EventACL 2019 Fourth Conference on Machine Translation - Florence, Italy
Duration: 1 Aug 20192 Aug 2019
http://www.statmt.org/wmt19/

Conference

ConferenceACL 2019 Fourth Conference on Machine Translation
Abbreviated titleWMT19
CountryItaly
CityFlorence
Period1/08/192/08/19
Internet address

Fingerprint Dive into the research topics of 'Findings of the WMT 2019 Biomedical Translation Shared Task: Evaluation for MEDLINE Abstracts and Biomedical Terminologies'. Together they form a unique fingerprint.

Cite this