Multi30K: Multilingual English-German Image Descriptions

Desmond Elliott; Stella Frank; Khalil Sima'an; Lucia Specia

doi:10.18653/v1/W16-3210

Multi30K: Multilingual English-German Image Descriptions

Desmond Elliott, Stella Frank, Khalil Sima'an, Lucia Specia

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We introduce the Multi30K dataset to stimulate multilingual multimodal research. Recent advances in image description have been demonstrated on English language datasets almost exclusively, but image description should not be limited to English. This dataset extends the Flickr30K dataset with i) German translations created by professional translators over a subset of the English descriptions, and ii) German descriptions crowd sourced independently of the original English descriptions. We describe the data and outline how it can be used for multilingual image description and multimodal machine translation, but we anticipate the data will be useful for a broader range of tasks.

Original language	English
Title of host publication	Proceedings of the 5th Workshop on Vision and Language, hosted by the 54th Annual Meeting of the Association for Computational Linguistics, VL@ACL 2016, August 12, Berlin, Germany
Publisher	Association for Computational Linguistics (ACL)
Pages	70-74
Number of pages	5
DOIs	https://doi.org/10.18653/v1/W16-3210
Publication status	Published - 12 Aug 2016
Event	5th Workshop on Vision and Language - Berlin, Germany Duration: 12 Aug 2016 → 12 Aug 2016 https://vision.cs.hacettepe.edu.tr/vl2016/

Conference

Conference	5th Workshop on Vision and Language
Abbreviated title	VL 2016
Country/Territory	Germany
City	Berlin
Period	12/08/16 → 12/08/16
Internet address	https://vision.cs.hacettepe.edu.tr/vl2016/

Access to Document

10.18653/v1/W16-3210Licence: Creative Commons: Attribution (CC-BY)

W16-3210Final published version, 795 KBLicence: Creative Commons: Attribution (CC-BY)

https://www.aclweb.org/anthology/W16-3210/Licence: Creative Commons: Attribution (CC-BY)

1 Finished

QT21: Quality Translation 21
Koehn, P., Haddow, B. & Huck, M.
EU government bodies
1/02/15 → 31/01/18
Project: Research

Cite this

Elliott, D., Frank, S., Sima'an, K., & Specia, L. (2016). Multi30K: Multilingual English-German Image Descriptions. In Proceedings of the 5th Workshop on Vision and Language, hosted by the 54th Annual Meeting of the Association for Computational Linguistics, VL@ACL 2016, August 12, Berlin, Germany (pp. 70-74). Association for Computational Linguistics (ACL). https://doi.org/10.18653/v1/W16-3210

Elliott, Desmond ; Frank, Stella ; Sima'an, Khalil ; Specia, Lucia. / Multi30K: Multilingual English-German Image Descriptions. Proceedings of the 5th Workshop on Vision and Language, hosted by the 54th Annual Meeting of the Association for Computational Linguistics, VL@ACL 2016, August 12, Berlin, Germany. Association for Computational Linguistics (ACL), 2016. pp. 70-74

@inproceedings{9224614cd3db4360b9fef4a280742108,

title = "Multi30K: Multilingual English-German Image Descriptions",

abstract = "We introduce the Multi30K dataset to stimulate multilingual multimodal research. Recent advances in image description have been demonstrated on English language datasets almost exclusively, but image description should not be limited to English. This dataset extends the Flickr30K dataset with i) German translations created by professional translators over a subset of the English descriptions, and ii) German descriptions crowd sourced independently of the original English descriptions. We describe the data and outline how it can be used for multilingual image description and multimodal machine translation, but we anticipate the data will be useful for a broader range of tasks.",

author = "Desmond Elliott and Stella Frank and Khalil Sima'an and Lucia Specia",

year = "2016",

month = aug,

day = "12",

doi = "10.18653/v1/W16-3210",

language = "English",

pages = "70--74",

booktitle = "Proceedings of the 5th Workshop on Vision and Language, hosted by the 54th Annual Meeting of the Association for Computational Linguistics, VL@ACL 2016, August 12, Berlin, Germany",

publisher = "Association for Computational Linguistics (ACL)",

note = "5th Workshop on Vision and Language, VL 2016 ; Conference date: 12-08-2016 Through 12-08-2016",

url = "https://vision.cs.hacettepe.edu.tr/vl2016/",

}

Elliott, D, Frank, S, Sima'an, K & Specia, L 2016, Multi30K: Multilingual English-German Image Descriptions. in Proceedings of the 5th Workshop on Vision and Language, hosted by the 54th Annual Meeting of the Association for Computational Linguistics, VL@ACL 2016, August 12, Berlin, Germany. Association for Computational Linguistics (ACL), pp. 70-74, 5th Workshop on Vision and Language, Berlin, Germany, 12/08/16. https://doi.org/10.18653/v1/W16-3210

Multi30K: Multilingual English-German Image Descriptions. / Elliott, Desmond; Frank, Stella; Sima'an, Khalil; Specia, Lucia.

Proceedings of the 5th Workshop on Vision and Language, hosted by the 54th Annual Meeting of the Association for Computational Linguistics, VL@ACL 2016, August 12, Berlin, Germany. Association for Computational Linguistics (ACL), 2016. p. 70-74.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Multi30K: Multilingual English-German Image Descriptions

AU - Elliott, Desmond

AU - Frank, Stella

AU - Sima'an, Khalil

AU - Specia, Lucia

PY - 2016/8/12

Y1 - 2016/8/12

N2 - We introduce the Multi30K dataset to stimulate multilingual multimodal research. Recent advances in image description have been demonstrated on English language datasets almost exclusively, but image description should not be limited to English. This dataset extends the Flickr30K dataset with i) German translations created by professional translators over a subset of the English descriptions, and ii) German descriptions crowd sourced independently of the original English descriptions. We describe the data and outline how it can be used for multilingual image description and multimodal machine translation, but we anticipate the data will be useful for a broader range of tasks.

AB - We introduce the Multi30K dataset to stimulate multilingual multimodal research. Recent advances in image description have been demonstrated on English language datasets almost exclusively, but image description should not be limited to English. This dataset extends the Flickr30K dataset with i) German translations created by professional translators over a subset of the English descriptions, and ii) German descriptions crowd sourced independently of the original English descriptions. We describe the data and outline how it can be used for multilingual image description and multimodal machine translation, but we anticipate the data will be useful for a broader range of tasks.

U2 - 10.18653/v1/W16-3210

DO - 10.18653/v1/W16-3210

M3 - Conference contribution

SP - 70

EP - 74

BT - Proceedings of the 5th Workshop on Vision and Language, hosted by the 54th Annual Meeting of the Association for Computational Linguistics, VL@ACL 2016, August 12, Berlin, Germany

PB - Association for Computational Linguistics (ACL)

T2 - 5th Workshop on Vision and Language

Y2 - 12 August 2016 through 12 August 2016

ER -

Elliott D, Frank S, Sima'an K, Specia L. Multi30K: Multilingual English-German Image Descriptions. In Proceedings of the 5th Workshop on Vision and Language, hosted by the 54th Annual Meeting of the Association for Computational Linguistics, VL@ACL 2016, August 12, Berlin, Germany. Association for Computational Linguistics (ACL). 2016. p. 70-74 https://doi.org/10.18653/v1/W16-3210

Multi30K: Multilingual English-German Image Descriptions

Abstract

Conference

Access to Document

Projects

QT21: Quality Translation 21

Cite this