A Shared Task on Multimodal Machine Translation and Crosslingual Image Description

Lucia Specia; Stella Frank; Khalil Sima'an; Desmond Elliott

doi:10.18653/v1/W16-2346

A Shared Task on Multimodal Machine Translation and Crosslingual Image Description

Lucia Specia, Stella Frank, Khalil Sima'an, Desmond Elliott

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper introduces and summarises the findings of a new shared task at the intersection of Natural Language Processing and Computer Vision: the generation of image descriptions in a target language, given an image and/or one or more descriptions in a different (source) language. This challenge was organised along with the Conference on Machine Translation (WMT16), and called for system submissions for two task variants: (i) a translation task, in which a source language image description needs to be translated to a target language, (optionally) with additional cues from the corresponding image, and (ii) a description generation task, in which a target language description needs to be generated for an image, (optionally) with additional cues from source language descriptions of the same image. In this first edition of the shared task, 16 systems were submitted for the translation task and seven for the image description task, from a total of 10 teams.

Original language	English
Title of host publication	Proceedings of the First Conference on Machine Translation, WMT 2016, colocated with ACL 2016, August 11-12, Berlin, Germany
Publisher	Association for Computational Linguistics (ACL)
Pages	543-553
Number of pages	11
DOIs	https://doi.org/10.18653/v1/W16-2346
Publication status	E-pub ahead of print - 12 Aug 2016
Event	First Conference on Machine Translation - Berlin, Germany Duration: 11 Aug 2016 → 12 Aug 2016 http://www.statmt.org/wmt16/

Conference

Conference	First Conference on Machine Translation
Abbreviated title	WMT16
Country/Territory	Germany
City	Berlin
Period	11/08/16 → 12/08/16
Internet address	http://www.statmt.org/wmt16/

Access to Document

10.18653/v1/W16-2346Licence: Creative Commons: Attribution (CC-BY)

W16-2346Final published version, 224 KBLicence: Creative Commons: Attribution (CC-BY)

https://www.aclweb.org/anthology/W16-2346/Licence: Creative Commons: Attribution (CC-BY)

1 Finished

QT21: Quality Translation 21
Koehn, P., Haddow, B. & Huck, M.
EU government bodies
1/02/15 → 31/01/18
Project: Research

Cite this

Specia, L., Frank, S., Sima'an, K., & Elliott, D. (2016). A Shared Task on Multimodal Machine Translation and Crosslingual Image Description. In Proceedings of the First Conference on Machine Translation, WMT 2016, colocated with ACL 2016, August 11-12, Berlin, Germany (pp. 543-553). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/W16-2346

@inproceedings{a719ed7e309141cbb31154d2343ae625,

title = "A Shared Task on Multimodal Machine Translation and Crosslingual Image Description",

abstract = "This paper introduces and summarises the findings of a new shared task at the intersection of Natural Language Processing and Computer Vision: the generation of image descriptions in a target language, given an image and/or one or more descriptions in a different (source) language. This challenge was organised along with the Conference on Machine Translation (WMT16), and called for system submissions for two task variants: (i) a translation task, in which a source language image description needs to be translated to a target language, (optionally) with additional cues from the corresponding image, and (ii) a description generation task, in which a target language description needs to be generated for an image, (optionally) with additional cues from source language descriptions of the same image. In this first edition of the shared task, 16 systems were submitted for the translation task and seven for the image description task, from a total of 10 teams.",

author = "Lucia Specia and Stella Frank and Khalil Sima'an and Desmond Elliott",

year = "2016",

month = aug,

day = "12",

doi = "10.18653/v1/W16-2346",

language = "English",

pages = "543--553",

booktitle = "Proceedings of the First Conference on Machine Translation, WMT 2016, colocated with ACL 2016, August 11-12, Berlin, Germany",

publisher = "Association for Computational Linguistics (ACL)",

note = "First Conference on Machine Translation, WMT16 ; Conference date: 11-08-2016 Through 12-08-2016",

url = "http://www.statmt.org/wmt16/",

}

Specia, L, Frank, S, Sima'an, K & Elliott, D 2016, A Shared Task on Multimodal Machine Translation and Crosslingual Image Description. in Proceedings of the First Conference on Machine Translation, WMT 2016, colocated with ACL 2016, August 11-12, Berlin, Germany. Association for Computational Linguistics (ACL), pp. 543-553, First Conference on Machine Translation, Berlin, Germany, 11/08/16. https://doi.org/10.18653/v1/W16-2346

A Shared Task on Multimodal Machine Translation and Crosslingual Image Description. / Specia, Lucia; Frank, Stella; Sima'an, Khalil; Elliott, Desmond.

Proceedings of the First Conference on Machine Translation, WMT 2016, colocated with ACL 2016, August 11-12, Berlin, Germany. Association for Computational Linguistics (ACL), 2016. p. 543-553.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - A Shared Task on Multimodal Machine Translation and Crosslingual Image Description

AU - Specia, Lucia

AU - Frank, Stella

AU - Sima'an, Khalil

AU - Elliott, Desmond

PY - 2016/8/12

Y1 - 2016/8/12

N2 - This paper introduces and summarises the findings of a new shared task at the intersection of Natural Language Processing and Computer Vision: the generation of image descriptions in a target language, given an image and/or one or more descriptions in a different (source) language. This challenge was organised along with the Conference on Machine Translation (WMT16), and called for system submissions for two task variants: (i) a translation task, in which a source language image description needs to be translated to a target language, (optionally) with additional cues from the corresponding image, and (ii) a description generation task, in which a target language description needs to be generated for an image, (optionally) with additional cues from source language descriptions of the same image. In this first edition of the shared task, 16 systems were submitted for the translation task and seven for the image description task, from a total of 10 teams.

AB - This paper introduces and summarises the findings of a new shared task at the intersection of Natural Language Processing and Computer Vision: the generation of image descriptions in a target language, given an image and/or one or more descriptions in a different (source) language. This challenge was organised along with the Conference on Machine Translation (WMT16), and called for system submissions for two task variants: (i) a translation task, in which a source language image description needs to be translated to a target language, (optionally) with additional cues from the corresponding image, and (ii) a description generation task, in which a target language description needs to be generated for an image, (optionally) with additional cues from source language descriptions of the same image. In this first edition of the shared task, 16 systems were submitted for the translation task and seven for the image description task, from a total of 10 teams.

U2 - 10.18653/v1/W16-2346

DO - 10.18653/v1/W16-2346

M3 - Conference contribution

SP - 543

EP - 553

BT - Proceedings of the First Conference on Machine Translation, WMT 2016, colocated with ACL 2016, August 11-12, Berlin, Germany

PB - Association for Computational Linguistics (ACL)

T2 - First Conference on Machine Translation

Y2 - 11 August 2016 through 12 August 2016

ER -

A Shared Task on Multimodal Machine Translation and Crosslingual Image Description

Abstract

Conference

Access to Document

Fingerprint

Projects

QT21: Quality Translation 21

Cite this