Explainable Agency for Intelligent Autonomous Systems

Pat Langley, Ben Meadows, Mohan Sridharan, Dongkyu Choi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

As intelligent agents become more autonomous, sophisticated, and prevalent, it becomes increasingly important that humans interact with them effectively. Machine learning is now used regularly to acquire expertise, but common techniques produce opaque content whose behavior is difficult to interpret. Before they will be trusted by humans, autonomous agents must be able to explain their decisions and the reasoning that produced their choices. We will refer to this general ability as explainable agency. This capacity for explaining decisions is not an academic exercise. When a self-driving vehicle takes an unfamiliar turn, its passenger may desire to know its reasons. When a synthetic ally in a computer game blocks a player's path, he may want to understand its purpose. When an autonomous military robot has abandoned a high-priority goal to pursue another one, its commander may request justification. As robots, vehicles, and synthetic characters become more self-reliant, people will require that they explain their behaviors on demand. The more impressive these agents' abilities, the more essential that we be able to understand them.
Original languageEnglish
Title of host publicationProceedings of the Twenty-Ninth AAAI Conference on Innovative Applications (IAAI-17)
PublisherAssociation for the Advancement of Artificial Intelligence
Pages4762-4763
Number of pages1
Volume31
Edition2
ISBN (Print)978-1-57735-785-8
DOIs
Publication statusPublished - 6 Feb 2017
EventTwenty-Ninth AAAI Conference on Innovative Applications (IAAI-17) - San Francisco, United States
Duration: 6 Feb 20179 Feb 2017

Publication series

Name
ISSN (Print)2159-5399
ISSN (Electronic)2374-3468

Conference

ConferenceTwenty-Ninth AAAI Conference on Innovative Applications (IAAI-17)
Country/TerritoryUnited States
CitySan Francisco
Period6/02/179/02/17

Keywords / Materials (for Non-textual outputs)

  • Autonomous agents
  • Cognitive systems
  • Explanation

Fingerprint

Dive into the research topics of 'Explainable Agency for Intelligent Autonomous Systems'. Together they form a unique fingerprint.

Cite this