Multi-lingual Evaluation of a Natural Language Generation System

Athanasios  Karasimos; Amy Isard

Multi-lingual Evaluation of a Natural Language Generation System

Athanasios Karasimos, Amy Isard

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper describes a user evaluation of the text output from the M-PIRO (Multilingual Personalised Information Objects) system, which dynamically generates descriptions of exhibits for a virtual museum. We show that subjects performed significantly better in a factual recall test when the descriptions included more sophisticated text structuring modules. The subjects also judged the structured texts to be more interesting and readable, and felt that they had learned more from them.

Original language	English
Title of host publication	LREC 2004 Fourth International Conference on Language Resources and Evaluation
Publisher	European Language Resources Association (ELRA)
Pages	829-832
Number of pages	4
ISBN (Print)	2-9517408-1-6
Publication status	Published - 2004

Access to Document

134Accepted author manuscript, 288 KB

http://www.lrec-conf.org/proceedings/lrec2004/pdf/134.pdf

Cite this

@inproceedings{4fb1314e42f54ecc983eccff4291941b,

title = "Multi-lingual Evaluation of a Natural Language Generation System",

abstract = "This paper describes a user evaluation of the text output from the M-PIRO (Multilingual Personalised Information Objects) system, which dynamically generates descriptions of exhibits for a virtual museum. We show that subjects performed significantly better in a factual recall test when the descriptions included more sophisticated text structuring modules. The subjects also judged the structured texts to be more interesting and readable, and felt that they had learned more from them.",

author = "Athanasios Karasimos and Amy Isard",

year = "2004",

language = "English",

isbn = "2-9517408-1-6",

pages = "829--832",

booktitle = "LREC 2004 Fourth International Conference on Language Resources and Evaluation",

publisher = "European Language Resources Association (ELRA)",

}

TY - GEN

T1 - Multi-lingual Evaluation of a Natural Language Generation System

AU - Karasimos, Athanasios

AU - Isard, Amy

PY - 2004

Y1 - 2004

N2 - This paper describes a user evaluation of the text output from the M-PIRO (Multilingual Personalised Information Objects) system, which dynamically generates descriptions of exhibits for a virtual museum. We show that subjects performed significantly better in a factual recall test when the descriptions included more sophisticated text structuring modules. The subjects also judged the structured texts to be more interesting and readable, and felt that they had learned more from them.

AB - This paper describes a user evaluation of the text output from the M-PIRO (Multilingual Personalised Information Objects) system, which dynamically generates descriptions of exhibits for a virtual museum. We show that subjects performed significantly better in a factual recall test when the descriptions included more sophisticated text structuring modules. The subjects also judged the structured texts to be more interesting and readable, and felt that they had learned more from them.

M3 - Conference contribution

SN - 2-9517408-1-6

SP - 829

EP - 832

BT - LREC 2004 Fourth International Conference on Language Resources and Evaluation

PB - European Language Resources Association (ELRA)

ER -

Multi-lingual Evaluation of a Natural Language Generation System

Abstract

Access to Document

Fingerprint

Cite this