Meta-Learning for Fast Adaptive Locomotion with Uncertainties in Environments and Robot Dynamics

Timothée Anne, Jack Wilkinson, Zhibin Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This work developed meta-learning control policies to achieve fast online adaptation to different changing conditions, which generate diverse and robust locomotion. The proposed method updates the interaction model constantly, samples feasible sequences of actions of estimated state-action trajectories, and then applies the optimal actions to maximize the reward. To achieve online model adaptation, our proposed method learns different latent vectors of each training condition, which is selected online based on newly collected data from the past 10 samples within 0.2s. Our work designs appropriate state space and reward functions, and optimizes feasible actions in an MPC fashion which are sampled directly in the joint space with constraints, hence requiring no prior design or training of specific gaits. We further demonstrated the robot’s capability of detecting unexpected changes during the interaction and adapting the control policy inless than 0.2s. The extensive validation on the SpotMicro robot in a physics simulation shows adaptive and robust locomotion skills under changing ground friction, external pushes, and different robot dynamics including motor failures and the whole leg amputation.
Original languageEnglish
Title of host publication2021 IEEE/RSJ International Conference on Intelligent Robots and Systems
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages4568-4575
Number of pages8
ISBN (Electronic)978-1-6654-1714-3
ISBN (Print)978-1-6654-1715-0
DOIs
Publication statusPublished - 16 Dec 2021
Event2021 IEEE/RSJ International Conference on Intelligent Robots and Systems - Online, Prague, Czech Republic
Duration: 27 Sep 20211 Oct 2021
https://www.iros2021.org/

Publication series

Name
ISSN (Print)2153-0858
ISSN (Electronic)2153-0866

Conference

Conference2021 IEEE/RSJ International Conference on Intelligent Robots and Systems
Abbreviated titleIROS 2021
Country/TerritoryCzech Republic
CityPrague
Period27/09/211/10/21
Internet address

Fingerprint

Dive into the research topics of 'Meta-Learning for Fast Adaptive Locomotion with Uncertainties in Environments and Robot Dynamics'. Together they form a unique fingerprint.

Cite this