Ethical reward machines

Jessica Ciupa, Vaishak Belle

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

The Ethical Reward Machine investigates reward design involving ethical constraints with reinforcement learning. Designed to promote good behaviour across specific domains, such as simulated driving and search-and-rescue scenarios, the Ethical Reward Machine explores ethical constraints based on Act Deontology and Utilitarianism. Our contribution to the literature is a novel algorithmic pipeline integrating ethical constraints into reinforcement learning through symbolic language.Our findings indicate ethical principles impact the system significantly if there is a dilemma, and that incorporating ethical principles does not increase runtime. Therefore, our results suggest that ethical considerations do not substantially burden computational resources. Ultimately,the overarching objective is to develop and validate a learning framework that ensures AI alignment with human learning and ethical policies.
Original languageEnglish
Title of host publicationProceedings of the 18th International Workshop on Neural-Symbolic Learning and Reasoning
Publication statusAccepted/In press - 7 Jun 2024
Event18th International Conference on Neural-Symbolic Learning and Reasoning - Barcelona, Spain
Duration: 9 Sept 202412 Sept 2024
https://sites.google.com/view/nesy2024

Publication series

NameProceedings of the International Conference for Neurosymbolic Learning and Reasoning
ISSN (Electronic)1613-0073

Conference

Conference18th International Conference on Neural-Symbolic Learning and Reasoning
Abbreviated titleNESY 2024
Country/TerritorySpain
CityBarcelona
Period9/09/2412/09/24
Internet address

Keywords / Materials (for Non-textual outputs)

  • knowledge representation
  • interpretable reinforcement learning
  • ethics

Fingerprint

Dive into the research topics of 'Ethical reward machines'. Together they form a unique fingerprint.

Cite this