Time-of-flight sensor fusion with depth measurement reliability weighting

S. Schwarz, M. Sjöström, R. Olsson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

Accurate scene depth capture is essential for the success of three-dimensional television (3DTV), e.g. for high quality view synthesis in autostereoscopic multiview displays. Unfortunately, scene depth is not easily obtained and often of limited quality. Dedicated Time-of-Flight (ToF) sensors can deliver reliable depth readings where traditional methods, such as stereovision analysis, fail. However, since ToF sensors provide only limited spatial resolution and suffer from sensor noise, sophisticated upsampling methods are sought after. A multitude of ToF solutions have been proposed over the recent years. Most of them achieve ToF superresolution (TSR) by sensor fusion between ToF and additional sources, e.g. video. We recently proposed a weighted error energy minimization approach for ToF super-resolution, incorporating texture, sensor noise and temporal information. For this article, we take a closer look at the sensor noise weighting related to the Time-of-Flight active brightness signal. We determine a depth measurement reliability function based on optimizing free parameters to test data and verifying it with independent test cases. In the presented double-weighted TSR proposal, depth readings are weighted into the upsampling process with regard to their reliability, removing erroneous influences in the final result. Our evaluations prove the desired effect of depth measurement reliability weighting, decreasing the depth upsampling error by almost 40% in comparison to competing proposals.
Original languageEnglish
Title of host publication3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), 2014
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Number of pages4
ISBN (Electronic)978-1-4799-4758-4
ISBN (Print)978-1-4799-4757-7
Publication statusPublished - Jul 2014


Dive into the research topics of 'Time-of-flight sensor fusion with depth measurement reliability weighting'. Together they form a unique fingerprint.

Cite this