Learning Motor Skills of Reactive Reaching and Grasping of Objects

Wenbin Hu, Chuanyu Yang, Kai Yuan, Zhibin Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

Reactive grasping of objects is an essential capability of autonomous robot manipulation, which is yet challenging to learn such sensorimotor control to coordinate coherent hand-finger motions and be robust against disturbances and failures. This work proposed a deep reinforcement learning based scheme to train feedback control policies which can coordinate reaching and grasping actions in presence of uncertainties. We formulated geometric metrics and task-orientated quantities to design the reward, which enabled efficient exploration of grasping policies. Further, to improve the success rate, we deployed key initial states of difficult hand-finger poses to train policies to overcome potential failures due to challenging configurations. The extensive simulation validations and benchmarks demonstrated that the learned policy was robust to grasp both static and moving objects. Moreover, the policy generated successful failure recoveries within a short time in difficult configurations and was robust with synthetic noises in the state feedback which were unseen during training.
Original languageEnglish
Title of host publication2021 IEEE International Conference on Robotics and Biomimetics
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages452-457
Number of pages6
ISBN (Electronic)978-1-6654-0535-5
ISBN (Print)978-1-6654-0536-2
DOIs
Publication statusPublished - 28 Mar 2022
Event2021 IEEE International Conference on Robotics and Biomimetics - Sanya, China
Duration: 6 Dec 202110 Dec 2021
https://ieee-robio.org/2021/

Conference

Conference2021 IEEE International Conference on Robotics and Biomimetics
Abbreviated titleROBIO 2021
Country/TerritoryChina
CitySanya
Period6/12/2110/12/21
Internet address

Fingerprint

Dive into the research topics of 'Learning Motor Skills of Reactive Reaching and Grasping of Objects'. Together they form a unique fingerprint.

Cite this