Talking Autonomous Vehicles: Automatic AUV Mission Analysis in Natural Language

Helen Hastie; Xingkun Liu; Pedro Patron; Yvan Petillot

doi:10.1109/OCEANSE.2017.8084617

Talking Autonomous Vehicles: Automatic AUV Mission Analysis in Natural Language

Helen Hastie, Xingkun Liu, Pedro Patron, Yvan Petillot

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract / Description of output

As AUVs are enabled with greater levels of autonomy, there is the need for them to clearly explain their actions and reasoning, maintaining a level of situation awareness and operator trust. Here, we describe the REGIME system that automatically generates natural language updates in real-time as well as post-mission reports. Specifically, the system takes time-series sensor data, mission logs, together with mission plans as its input, and generates descriptions of the missions in natural language. These natural language updates can be used in isolation or as an add-on to existing interfaces such as SeeByte's SeeTrack common operator interface. A usability study reflects the high situation awareness induced by the system, as well as interest in future use.

Original language	English
Title of host publication	OCEANS 2017 - Aberdeen
Publisher	Institute of Electrical and Electronics Engineers
Pages	1-5
Number of pages	5
ISBN (Electronic)	9781509052783
ISBN (Print)	9781509052790
DOIs	https://doi.org/10.1109/OCEANSE.2017.8084617
Publication status	Published - 19 Jun 2017
Event	OCEANS - Aberdeen Exhibition and Conference Centre, Aberdeen, United Kingdom Duration: 19 Jun 2017 → 22 Jun 2017 http://aberdeen17.oceansconference.org/

Conference

Conference	OCEANS
Country/Territory	United Kingdom
City	Aberdeen
Period	19/06/17 → 22/06/17
Internet address	http://aberdeen17.oceansconference.org/

Access to Document

10.1109/OCEANSE.2017.8084617Licence: All Rights Reserved

https://ieeexplore.ieee.org/abstract/document/8084617Licence: All Rights Reserved

Cite this

@inproceedings{12bb8c26633243049c448a8cda4e0857,

title = "Talking Autonomous Vehicles: Automatic AUV Mission Analysis in Natural Language",

abstract = "As AUVs are enabled with greater levels of autonomy, there is the need for them to clearly explain their actions and reasoning, maintaining a level of situation awareness and operator trust. Here, we describe the REGIME system that automatically generates natural language updates in real-time as well as post-mission reports. Specifically, the system takes time-series sensor data, mission logs, together with mission plans as its input, and generates descriptions of the missions in natural language. These natural language updates can be used in isolation or as an add-on to existing interfaces such as SeeByte's SeeTrack common operator interface. A usability study reflects the high situation awareness induced by the system, as well as interest in future use.",

author = "Helen Hastie and Xingkun Liu and Pedro Patron and Yvan Petillot",

year = "2017",

month = jun,

day = "19",

doi = "10.1109/OCEANSE.2017.8084617",

language = "English",

isbn = "9781509052790",

pages = "1--5",

booktitle = "OCEANS 2017 - Aberdeen",

publisher = "Institute of Electrical and Electronics Engineers",

address = "United States",

note = "OCEANS ; Conference date: 19-06-2017 Through 22-06-2017",

url = "http://aberdeen17.oceansconference.org/",

}

TY - GEN

T1 - Talking Autonomous Vehicles: Automatic AUV Mission Analysis in Natural Language

AU - Hastie, Helen

AU - Liu, Xingkun

AU - Patron, Pedro

AU - Petillot, Yvan

PY - 2017/6/19

Y1 - 2017/6/19

N2 - As AUVs are enabled with greater levels of autonomy, there is the need for them to clearly explain their actions and reasoning, maintaining a level of situation awareness and operator trust. Here, we describe the REGIME system that automatically generates natural language updates in real-time as well as post-mission reports. Specifically, the system takes time-series sensor data, mission logs, together with mission plans as its input, and generates descriptions of the missions in natural language. These natural language updates can be used in isolation or as an add-on to existing interfaces such as SeeByte's SeeTrack common operator interface. A usability study reflects the high situation awareness induced by the system, as well as interest in future use.

AB - As AUVs are enabled with greater levels of autonomy, there is the need for them to clearly explain their actions and reasoning, maintaining a level of situation awareness and operator trust. Here, we describe the REGIME system that automatically generates natural language updates in real-time as well as post-mission reports. Specifically, the system takes time-series sensor data, mission logs, together with mission plans as its input, and generates descriptions of the missions in natural language. These natural language updates can be used in isolation or as an add-on to existing interfaces such as SeeByte's SeeTrack common operator interface. A usability study reflects the high situation awareness induced by the system, as well as interest in future use.

U2 - 10.1109/OCEANSE.2017.8084617

DO - 10.1109/OCEANSE.2017.8084617

M3 - Conference contribution

SN - 9781509052790

SP - 1

EP - 5

BT - OCEANS 2017 - Aberdeen

PB - Institute of Electrical and Electronics Engineers

T2 - OCEANS

Y2 - 19 June 2017 through 22 June 2017

ER -

Talking Autonomous Vehicles: Automatic AUV Mission Analysis in Natural Language

Abstract / Description of output

Conference

Access to Document

Fingerprint

Cite this