Learning Pregrasp Manipulation of Objects from Ungraspable Poses

Zhaole Sun, Kai Yuan, Wenbin Hu, Chuanyu Yang, Zhibin Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

In robotic grasping, objects are often occluded in ungraspable configurations such that no pregrasp pose can be found, eg large flat boxes on the table that can only be grasped from the side. Inspired by humans’ bimanual manipulation, eg one hand to lift up things and the other to grasp, we address this type of problems by introducing pregrasp manipulation – push and lift actions. We propose a model-free Deep Reinforcement Learning framework to train control policies that utilize visual information and proprioceptive states of the robot to autonomously discover robust pregrasp manipulation. The robot arm learns to first push the object towards a support surface and establishes a pivot to lift up one side of the object, thus creating a clearance between the object and the table for possible grasping solutions. Furthermore, we show the effectiveness of our proposed learning framework in training robust pregrasp policies that can directly transfer from simulation to real hardware through suitable design of training procedures, state, and action space. Lastly, we evaluate the effectiveness and the generalisation ability of the learned policies in real-world experiments, and demonstrate pregrasp manipulation of objects with various size, shape, weight, and surface friction.
Original languageEnglish
Title of host publication2020 IEEE International Conference on Robotics and Automation (ICRA)
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Number of pages7
ISBN (Electronic)978-1-7281-7395-5
ISBN (Print)978-1-7281-7396-2
Publication statusPublished - 15 Sept 2020
Event2020 International Conference on Robotics and Automation - Virtual conference, France
Duration: 31 May 202031 Aug 2020

Publication series

ISSN (Print)1050-4729
ISSN (Electronic)2577-087X


Conference2020 International Conference on Robotics and Automation
Abbreviated titleICRA 2020
CityVirtual conference
Internet address


Dive into the research topics of 'Learning Pregrasp Manipulation of Objects from Ungraspable Poses'. Together they form a unique fingerprint.

Cite this