Guided Direct Time-of-Flight Lidar Using Stereo Cameras for Enhanced Laser Power Efficiency

Filip Taneski, Istvan Gyongy, Tarek Al Abbas, Robert K. Henderson

Research output: Contribution to journalArticlepeer-review

Abstract / Description of output

Self-driving vehicles demand efficient and reliable depth-sensing technologies. Lidar, with its capability for long-distance, high-precision measurement, is a crucial component in this pursuit. However, conventional mechanical scanning implementations suffer from reliability, cost, and frame rate limitations. Solid-state lidar solutions have emerged as a promising alternative, but the vast amount of photon data processed and stored using conventional direct time-of-flight (dToF) prevents long-distance sensing unless power-intensive partial histogram approaches are used. In this paper, we introduce a groundbreaking ‘guided’ dToF approach, harnessing external guidance from other onboard sensors to narrow down the depth search space for a power and data-efficient solution. This approach centers around a dToF sensor in which the exposed time window of independent pixels can be dynamically adjusted. We utilize a 64-by-32 macropixel dToF sensor and a pair of vision cameras to provide the guiding depth estimates. Our demonstrator captures a dynamic outdoor scene at 3 fps with distances up to 75 m. Compared to a conventional full histogram approach, on-chip data is reduced by over twenty times, while the total laser cycles in each frame are reduced by at least six times compared to any partial histogram approach. The capability of guided dToF to mitigate multipath reflections is also demonstrated. For self-driving vehicles where a wealth of sensor data is already available, guided dToF opens new possibilities for efficient solid-state lidar.
Original languageEnglish
Article number8943
Number of pages18
Issue number21
Early online date3 Nov 2023
Publication statusE-pub ahead of print - 3 Nov 2023

Keywords / Materials (for Non-textual outputs)

  • 3D vision
  • SPADs
  • dToF
  • direct time-of-flight
  • flash lidar
  • lidar
  • stereo depth


Dive into the research topics of 'Guided Direct Time-of-Flight Lidar Using Stereo Cameras for Enhanced Laser Power Efficiency'. Together they form a unique fingerprint.

Cite this