Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study

Werner Breitfuss; Ielka Van Der Sluis; Saturnino Luz; Helmut Prendinger; Mitsuru Ishizuka

doi:10.1007/978-3-642-04380-2_22

Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study

Werner Breitfuss^*, Ielka Van Der Sluis, Saturnino Luz, Helmut Prendinger, Mitsuru Ishizuka

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.

Original language	English
Title of host publication	Intelligent Virtual Agents - 9th International Conference, IVA 2009, Proceedings
Pages	181-187
Number of pages	7
DOIs	https://doi.org/10.1007/978-3-642-04380-2_22
Publication status	Published - 2009
Event	9th International Conference on Intelligent Virtual Agents, IVA 2009 - Amsterdam, Netherlands Duration: 14 Sept 2009 → 16 Sept 2009

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	5773 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	9th International Conference on Intelligent Virtual Agents, IVA 2009
Country/Territory	Netherlands
City	Amsterdam
Period	14/09/09 → 16/09/09

Keywords / Materials (for Non-textual outputs)

Automatic Behavior Generation
Embodied Conversational Agents
Generation of Multimodal Referring Expressions
Virtual Worlds

Access to Document

10.1007/978-3-642-04380-2_22

Cite this

Breitfuss, W., Van Der Sluis, I., Luz, S., Prendinger, H., & Ishizuka, M. (2009). Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study. In Intelligent Virtual Agents - 9th International Conference, IVA 2009, Proceedings (pp. 181-187). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5773 LNAI). https://doi.org/10.1007/978-3-642-04380-2_22

Breitfuss, Werner ; Van Der Sluis, Ielka ; Luz, Saturnino et al. / Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world : A pilot study. Intelligent Virtual Agents - 9th International Conference, IVA 2009, Proceedings. 2009. pp. 181-187 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{b5359c97f645427988a8a1f45dc68ed7,

title = "Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study",

abstract = "This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.",

keywords = "Automatic Behavior Generation, Embodied Conversational Agents, Generation of Multimodal Referring Expressions, Virtual Worlds",

author = "Werner Breitfuss and {Van Der Sluis}, Ielka and Saturnino Luz and Helmut Prendinger and Mitsuru Ishizuka",

year = "2009",

doi = "10.1007/978-3-642-04380-2_22",

language = "English",

isbn = "3642043798",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "181--187",

booktitle = "Intelligent Virtual Agents - 9th International Conference, IVA 2009, Proceedings",

note = "9th International Conference on Intelligent Virtual Agents, IVA 2009 ; Conference date: 14-09-2009 Through 16-09-2009",

}

Breitfuss, W, Van Der Sluis, I, Luz, S, Prendinger, H & Ishizuka, M 2009, Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study. in Intelligent Virtual Agents - 9th International Conference, IVA 2009, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5773 LNAI, pp. 181-187, 9th International Conference on Intelligent Virtual Agents, IVA 2009, Amsterdam, Netherlands, 14/09/09. https://doi.org/10.1007/978-3-642-04380-2_22

Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study. / Breitfuss, Werner; Van Der Sluis, Ielka; Luz, Saturnino et al.
Intelligent Virtual Agents - 9th International Conference, IVA 2009, Proceedings. 2009. p. 181-187 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5773 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world

T2 - 9th International Conference on Intelligent Virtual Agents, IVA 2009

AU - Breitfuss, Werner

AU - Van Der Sluis, Ielka

AU - Luz, Saturnino

AU - Prendinger, Helmut

AU - Ishizuka, Mitsuru

PY - 2009

Y1 - 2009

N2 - This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.

AB - This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.

KW - Automatic Behavior Generation

KW - Embodied Conversational Agents

KW - Generation of Multimodal Referring Expressions

KW - Virtual Worlds

UR - http://www.scopus.com/inward/record.url?scp=70350409675&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-04380-2_22

DO - 10.1007/978-3-642-04380-2_22

M3 - Conference contribution

AN - SCOPUS:70350409675

SN - 3642043798

SN - 9783642043796

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 181

EP - 187

BT - Intelligent Virtual Agents - 9th International Conference, IVA 2009, Proceedings

Y2 - 14 September 2009 through 16 September 2009

ER -

Breitfuss W, Van Der Sluis I, Luz S, Prendinger H, Ishizuka M. Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study. In Intelligent Virtual Agents - 9th International Conference, IVA 2009, Proceedings. 2009. p. 181-187. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-04380-2_22

Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study

Abstract

Publication series

Conference

Keywords / Materials (for Non-textual outputs)

Access to Document

Other files and links

Fingerprint

Cite this