A 128 × 128 SPAD Motion-Triggered Time of Flight Image Sensor with In-Pixel Histogram and Column-Parallel Vision Processor

Francesco Mattioli Della Rocca, Hanning Mai, Sam Hutchings, Tarek Al Abbas, Kasper Buckbee, Andreas Tsiamis, Peter Lomax, Istvan Gyongy, Neale Dutton, Robert Henderson

Research output: Contribution to journalArticlepeer-review

Abstract

A 128 x 128 SPAD motion detection-triggered time of flight (ToF) sensor is implemented in STMicroelectronics 40 nm CMOS SPAD foundry process. The sensor combines vision and ToF ranging functions to acquire depth frames only when inter-frame intensity changes are detected. The 40 μm x 20 μm pixel integrates two 16-bit time-gated counters to acquire ToF histograms and repurposes them to compare two vision frames without requirement for additional out-of-pixel frame memory resources. An embedded column-parallel ToF and vision processor performs on-chip vision frame comparison and binary frame output compression as well as controlling the time-resolved histogram sampling. The sensor achieves a maximum 32.5 kfps in vision modality and 500 fps in motion detection-triggered ToF over a measured 3.5 m distance with 1.5 cm accuracy. The vision function reduces the sensor power consumption by 70% over continuous ToF operation and allows the sensor to gate the ToF laser emitter to reduce the system power when no motion activity is observed.
Original languageEnglish
Pages (from-to)1762-1775
Number of pages13
JournalIEEE Journal of Solid-State Circuits
Volume55
Issue number7
Early online date20 May 2020
DOIs
Publication statusPublished - 1 Jul 2020

Fingerprint

Dive into the research topics of 'A 128 × 128 SPAD Motion-Triggered Time of Flight Image Sensor with In-Pixel Histogram and Column-Parallel Vision Processor'. Together they form a unique fingerprint.

Cite this