Surprise Languages: Rapid-Response Cross-Language IR

Douglas W. Oard; Marine Carpuat; Petra Galuscakova; Joseph Barrow; Suraj Nair; Xing Niu; Han-Chin Shing; Weijia Xu; Elena Zotkina; Kathleen McKeown; Smaranda Muresan; Efsun Selin Kayi; Ramy Eskander; Chris Kedzie; Yan Virin; Dragomir R. Radev; Rui Zhang; Mark J F Gales; Anton Ragni; Kenneth Heafield

Surprise Languages: Rapid-Response Cross-Language IR

Douglas W. Oard, Marine Carpuat, Petra Galuscakova, Joseph Barrow, Suraj Nair, Xing Niu, Han-Chin Shing, Weijia Xu, Elena Zotkina, Kathleen McKeown, Smaranda Muresan, Efsun Selin Kayi, Ramy Eskander, Chris Kedzie, Yan Virin, Dragomir R. Radev, Rui Zhang, Mark J F Gales, Anton Ragni, Kenneth Heafield

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Sixteen years ago, the first "surprise language exercise" was conducted, in Cebuano. The evaluation goal of a surprise language exercise is to learn how well systems for a new language can be quickly built. This paper briefly reviews the history of surprise language exercises. Some details from the most recent surprise language exercise, in Lithuanian, are included to help to illustrate how the state of the art has advanced over this period.

Original language	English
Title of host publication	Proceedings of the Ninth International Workshop on Evaluating Information Access (EVIA 2019)
Subtitle of host publication	a Satellite Workshop of the NTCIR-14 Conference, June 10, 2019 Tokyo Japan
Editors	Nicola Ferro, Emi Ishita, Noriko Kando, Makoto P. Kato, Ian Soboroff, Min Zhang
Publisher	National Institute of Informatics
Pages	23-27
Number of pages	5
ISBN (Print)	978-4-86049-077-5
Publication status	Published - 10 Jun 2019
Event	The Ninth International Workshop on Evaluating Information Access (EVIA 2019): a Satellite Workshop of the NTCIR-14 Conference - Tokio, Japan Duration: 10 Jun 2019 → 10 Jun 2019 Conference number: 9th http://research.nii.ac.jp/ntcir/evia2019/

Conference

Conference	The Ninth International Workshop on Evaluating Information Access (EVIA 2019)
Abbreviated title	EVIA 2019
Country/Territory	Japan
City	Tokio
Period	10/06/19 → 10/06/19
Internet address	http://research.nii.ac.jp/ntcir/evia2019/

Keywords

Fast
Retrieval
Evaluation

Access to Document

Surprise Languages Rapid-Response_HEAFIELD_DoA200519_AFV
©2019 National Institute of Informatics
Accepted author manuscript, 598 KBLicence: All Rights Reserved

http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings14/EVIA/toc_evia.html

Cite this

Oard, D. W., Carpuat, M., Galuscakova, P., Barrow, J., Nair, S., Niu, X., Shing, H-C., Xu, W., Zotkina, E., McKeown, K., Muresan, S., Kayi, E. S., Eskander, R., Kedzie, C., Virin, Y., Radev, D. R., Zhang, R., Gales, M. J. F., Ragni, A., & Heafield, K. (2019). Surprise Languages: Rapid-Response Cross-Language IR. In N. Ferro, E. Ishita, N. Kando, M. P. Kato, I. Soboroff, & M. Zhang (Eds.), Proceedings of the Ninth International Workshop on Evaluating Information Access (EVIA 2019): a Satellite Workshop of the NTCIR-14 Conference, June 10, 2019 Tokyo Japan (pp. 23-27). National Institute of Informatics. http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings14/EVIA/toc_evia.html

Oard, Douglas W. ; Carpuat, Marine ; Galuscakova, Petra et al. / Surprise Languages: Rapid-Response Cross-Language IR. Proceedings of the Ninth International Workshop on Evaluating Information Access (EVIA 2019): a Satellite Workshop of the NTCIR-14 Conference, June 10, 2019 Tokyo Japan. editor / Nicola Ferro ; Emi Ishita ; Noriko Kando ; Makoto P. Kato ; Ian Soboroff ; Min Zhang. National Institute of Informatics, 2019. pp. 23-27

@inproceedings{8ff207da1f78474e9d3a7395e79bcf32,

title = "Surprise Languages: Rapid-Response Cross-Language IR",

abstract = "Sixteen years ago, the first {"}surprise language exercise{"} was conducted, in Cebuano. The evaluation goal of a surprise language exercise is to learn how well systems for a new language can be quickly built. This paper briefly reviews the history of surprise language exercises. Some details from the most recent surprise language exercise, in Lithuanian, are included to help to illustrate how the state of the art has advanced over this period.",

keywords = "Fast, Retrieval, Evaluation",

author = "Oard, {Douglas W.} and Marine Carpuat and Petra Galuscakova and Joseph Barrow and Suraj Nair and Xing Niu and Han-Chin Shing and Weijia Xu and Elena Zotkina and Kathleen McKeown and Smaranda Muresan and Kayi, {Efsun Selin} and Ramy Eskander and Chris Kedzie and Yan Virin and Radev, {Dragomir R.} and Rui Zhang and Gales, {Mark J F} and Anton Ragni and Kenneth Heafield",

year = "2019",

month = jun,

day = "10",

language = "English",

isbn = "978-4-86049-077-5",

pages = "23--27",

editor = "Ferro, {Nicola } and Emi Ishita and Noriko Kando and Kato, {Makoto P.} and Ian Soboroff and Min Zhang",

booktitle = "Proceedings of the Ninth International Workshop on Evaluating Information Access (EVIA 2019)",

publisher = "National Institute of Informatics",

note = "The Ninth International Workshop on Evaluating Information Access (EVIA 2019) : a Satellite Workshop of the NTCIR-14 Conference, EVIA 2019 ; Conference date: 10-06-2019 Through 10-06-2019",

url = "http://research.nii.ac.jp/ntcir/evia2019/",

}

Oard, DW, Carpuat, M, Galuscakova, P, Barrow, J, Nair, S, Niu, X, Shing, H-C, Xu, W, Zotkina, E, McKeown, K, Muresan, S, Kayi, ES, Eskander, R, Kedzie, C, Virin, Y, Radev, DR, Zhang, R, Gales, MJF, Ragni, A & Heafield, K 2019, Surprise Languages: Rapid-Response Cross-Language IR. in N Ferro, E Ishita, N Kando, MP Kato, I Soboroff & M Zhang (eds), Proceedings of the Ninth International Workshop on Evaluating Information Access (EVIA 2019): a Satellite Workshop of the NTCIR-14 Conference, June 10, 2019 Tokyo Japan. National Institute of Informatics, pp. 23-27, The Ninth International Workshop on Evaluating Information Access (EVIA 2019), Tokio, Japan, 10/06/19. <http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings14/EVIA/toc_evia.html>

Surprise Languages: Rapid-Response Cross-Language IR. / Oard, Douglas W.; Carpuat, Marine; Galuscakova, Petra et al.

Proceedings of the Ninth International Workshop on Evaluating Information Access (EVIA 2019): a Satellite Workshop of the NTCIR-14 Conference, June 10, 2019 Tokyo Japan. ed. / Nicola Ferro; Emi Ishita; Noriko Kando; Makoto P. Kato; Ian Soboroff; Min Zhang. National Institute of Informatics, 2019. p. 23-27.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Surprise Languages: Rapid-Response Cross-Language IR

AU - Oard, Douglas W.

AU - Carpuat, Marine

AU - Galuscakova, Petra

AU - Barrow, Joseph

AU - Nair, Suraj

AU - Niu, Xing

AU - Shing, Han-Chin

AU - Xu, Weijia

AU - Zotkina, Elena

AU - McKeown, Kathleen

AU - Muresan, Smaranda

AU - Kayi, Efsun Selin

AU - Eskander, Ramy

AU - Kedzie, Chris

AU - Virin, Yan

AU - Radev, Dragomir R.

AU - Zhang, Rui

AU - Gales, Mark J F

AU - Ragni, Anton

AU - Heafield, Kenneth

N1 - Conference code: 9th

PY - 2019/6/10

Y1 - 2019/6/10

N2 - Sixteen years ago, the first "surprise language exercise" was conducted, in Cebuano. The evaluation goal of a surprise language exercise is to learn how well systems for a new language can be quickly built. This paper briefly reviews the history of surprise language exercises. Some details from the most recent surprise language exercise, in Lithuanian, are included to help to illustrate how the state of the art has advanced over this period.

AB - Sixteen years ago, the first "surprise language exercise" was conducted, in Cebuano. The evaluation goal of a surprise language exercise is to learn how well systems for a new language can be quickly built. This paper briefly reviews the history of surprise language exercises. Some details from the most recent surprise language exercise, in Lithuanian, are included to help to illustrate how the state of the art has advanced over this period.

KW - Fast

KW - Retrieval

KW - Evaluation

UR - http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings14/EVIA/abstract_evia.html#EVIA04

M3 - Conference contribution

SN - 978-4-86049-077-5

SP - 23

EP - 27

BT - Proceedings of the Ninth International Workshop on Evaluating Information Access (EVIA 2019)

A2 - Ferro, Nicola

A2 - Ishita, Emi

A2 - Kando, Noriko

A2 - Kato, Makoto P.

A2 - Soboroff, Ian

A2 - Zhang, Min

PB - National Institute of Informatics

T2 - The Ninth International Workshop on Evaluating Information Access (EVIA 2019)

Y2 - 10 June 2019 through 10 June 2019

ER -

Oard DW, Carpuat M, Galuscakova P, Barrow J, Nair S, Niu X et al. Surprise Languages: Rapid-Response Cross-Language IR. In Ferro N, Ishita E, Kando N, Kato MP, Soboroff I, Zhang M, editors, Proceedings of the Ninth International Workshop on Evaluating Information Access (EVIA 2019): a Satellite Workshop of the NTCIR-14 Conference, June 10, 2019 Tokyo Japan. National Institute of Informatics. 2019. p. 23-27

Surprise Languages: Rapid-Response Cross-Language IR

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this