Projects per year
Differential dynamic programming (DDP) is a direct single shooting method for trajectory optimization. Its efficiency derives from the exploitation of temporal structure (inherent to optimal control problems) and explicit roll-out/integration of the system dynamics. However, it suffers from numerical instability and, when compared to direct multiple shooting methods, it has limited initialization options (allows initialization of controls, but not of states) and lacks proper handling of control constraints. In this work, we tackle these issues with a feasibility-driven approach that regulates the dynamic feasibility during the numerical optimization and ensures control limits. Our feasibility search emulates the numerical resolution of a direct multiple shooting problem with only dynamics constraints. We show that our approach (named Box-FDDP) has better numerical convergence than Box-DDP$$^+$$(a single shooting method), and that its convergence rate and runtime performance are competitive with state-of-the-art direct transcription formulations solved using the interior point and active set algorithms available in Knitro. We further show that Box-FDDP decreases the dynamic feasibility error monotonically—as in state-of-the-art nonlinear programming algorithms. We demonstrate the benefits of our approach by generating complex and athletic motions for quadruped and humanoid robots. Finally, we highlight that Box-FDDP is suitable for model predictive control in legged robots.
|Number of pages||21|
|Early online date||21 Sep 2022|
|Publication status||Published - 1 Dec 2022|
- Optimal control
- Differential dynamic programming
- Direct multiple shooting
- Control limits
FingerprintDive into the research topics of 'A feasibility-driven approach to control-limited DDP'. Together they form a unique fingerprint.
Turing AI research Programme
1/09/18 → 31/08/23
MEMMO - Memory of Motion
1/01/18 → 30/06/22
UK Robotics and Artificial Intelligence Hub for Offshore Energy Asset Integrity Management (ORCA)
Vijayakumar, S., Mistry, M., Ramamoorthy, R. & Williams, C.
1/10/17 → 31/03/22