MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems

Helen Hastie; Francisco Javier Chiyah Garcia; David A. Robb; Pedro Patron; Atanas Laskov

doi:10.1145/3136755.3143022

MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems

Helen Hastie, Francisco Javier Chiyah Garcia, David A. Robb, Pedro Patron, Atanas Laskov

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.

Original language	English
Title of host publication	Proceedings of the 19th ACM International Conference on Multimodal Interaction
Place of Publication	United States
Publisher	ACM Association for Computing Machinery
Pages	495-496
Number of pages	2
ISBN (Print)	9781450355438
DOIs	https://doi.org/10.1145/3136755.3143022
Publication status	Published - 3 Nov 2017
Event	19th ACM International Conference on Multimodal Interaction - Glasgow, United Kingdom Duration: 13 Nov 2017 → 17 Nov 2017 Conference number: 19 https://icmi.acm.org/2017/

Conference

Conference	19th ACM International Conference on Multimodal Interaction
Abbreviated title	ICMI 2017
Country/Territory	United Kingdom
City	Glasgow
Period	13/11/17 → 17/11/17
Internet address	https://icmi.acm.org/2017/

Keywords / Materials (for Non-textual outputs)

autonomous systems
Multimodal output
natural language generation

Access to Document

10.1145/3136755.3143022Licence: All Rights Reserved

https://dl.acm.org/doi/10.1145/3136755.3143022Licence: All Rights Reserved

Cite this

@inproceedings{3bf3ec6998b44ae4b7b5f0ece678fd82,

title = "MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems",

abstract = "We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.",

keywords = "autonomous systems, Multimodal output, natural language generation",

author = "Helen Hastie and Garcia, \{Francisco Javier Chiyah\} and Robb, \{David A.\} and Pedro Patron and Atanas Laskov",

note = "This research was funded by DSTL (MIRIAM/ACC101939); and the RAEng/Leverhulme Trust Senior Research Fellowship Scheme (Hastie/LTSRF1617/13/37). We acknowledge Prof. Y Petillot, Dr X Liu and Dr Z Wang for their input and guidance. ; 19th ACM International Conference on Multimodal Interaction, ICMI 2017 ; Conference date: 13-11-2017 Through 17-11-2017",

year = "2017",

month = nov,

day = "3",

doi = "10.1145/3136755.3143022",

language = "English",

isbn = "9781450355438",

pages = "495--496",

booktitle = "Proceedings of the 19th ACM International Conference on Multimodal Interaction",

publisher = "ACM Association for Computing Machinery",

url = "https://icmi.acm.org/2017/",

}

Hastie, H, Garcia, FJC, Robb, DA, Patron, P & Laskov, A 2017, MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems. in Proceedings of the 19th ACM International Conference on Multimodal Interaction. ACM Association for Computing Machinery, United States, pp. 495-496, 19th ACM International Conference on Multimodal Interaction, Glasgow, United Kingdom, 13/11/17. https://doi.org/10.1145/3136755.3143022

MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems. / Hastie, Helen; Garcia, Francisco Javier Chiyah; Robb, David A. et al.
Proceedings of the 19th ACM International Conference on Multimodal Interaction. United States: ACM Association for Computing Machinery, 2017. p. 495-496.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems

AU - Hastie, Helen

AU - Garcia, Francisco Javier Chiyah

AU - Robb, David A.

AU - Patron, Pedro

AU - Laskov, Atanas

N1 - Conference code: 19

PY - 2017/11/3

Y1 - 2017/11/3

N2 - We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.

AB - We present MIRIAM (Multimodal Intelligent inteRactIon for Autonomous systeMs), a multimodal interface to support situation awareness of autonomous vehicles through chat-based interaction. The user is able to chat about the vehicle's plan, objectives, previous activities and mission progress. The system is mixed initiative in that it pro-actively sends messages about key events, such as fault warnings. We will demonstrate MIRIAM using SeeByte's SeeTrack command and control interface and Neptune autonomy simulator.

KW - autonomous systems

KW - Multimodal output

KW - natural language generation

UR - https://researchportal.hw.ac.uk/en/publications/miriam-a-multimodal-chat-based-interface-for-autonomous-systems

U2 - 10.1145/3136755.3143022

DO - 10.1145/3136755.3143022

M3 - Conference contribution

SN - 9781450355438

SP - 495

EP - 496

BT - Proceedings of the 19th ACM International Conference on Multimodal Interaction

PB - ACM Association for Computing Machinery

CY - United States

T2 - 19th ACM International Conference on Multimodal Interaction

Y2 - 13 November 2017 through 17 November 2017

ER -

MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems

Abstract

Conference

Keywords / Materials (for Non-textual outputs)

Access to Document

Other files and links

Fingerprint

Cite this