Learning action effects in partially observable domains

Kira Mourao, Ron Petrick, Mark Steedman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We investigate the problem of learning action effects in partially observable STRIPS planning domains. Our approach is based on a voted kernel perceptron learning model, where action and state information is encoded in a compact vector representation as input to the learning mechanism, and resulting state changes are produced as output. Our approach relies on deictic features that embody a notion of attention and reduce the size of the representation. We evaluate our approach on a number of partially observable planning domains, adapted from domains used in the International Planning Competition, and show that it can quickly learn the dynamics of such domains, with low average error rates. Furthermore, we show that our approach handles noisy domains, and scales independently of the number of objects in a domain, making it suitable for large planning scenarios.
Original languageEnglish
Title of host publicationProceedings of the ICAPS 2009 Workshop on Planning and Learning
Pages15-22
Number of pages8
Publication statusPublished - 2009

Fingerprint

Dive into the research topics of 'Learning action effects in partially observable domains'. Together they form a unique fingerprint.

Cite this