Structured Prediction of Unobserved Voxels from a Single Depth Image

Michael Firman, Oisin Mac Aodha, Simon Julier, Gabriel J. Brostow

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Building a complete 3D model of a scene, given only a single depth image, is underconstrained. To gain a full volumetric model, one needs either multiple views, or a single view together with a library of unambiguous 3D models that will fit the shape of each individual object in the scene.

We hypothesize that objects of dissimilar semantic classes often share similar 3D shape components, enabling a limited dataset to model the shape of a wide range of objects, and hence estimate their hidden geometry. Exploring this hypothesis, we propose an algorithm that can complete the unobserved geometry of tabletop-sized objects, based on a supervised model trained on already available volumetric elements. Our model maps from a local observation in a single depth image to an estimate of the surface shape in the surrounding neighborhood. We validate our approach both qualitatively and quantitatively on a range of indoor object collections and challenging real scenes.
Original languageEnglish
Title of host publication2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages5431-5440
Number of pages10
ISBN (Electronic)978-1-4673-8851-1
ISBN (Print)978-1-4673-8852-8
DOIs
Publication statusPublished - 12 Dec 2016
Event29th IEEE Conference on Computer Vision and Pattern Recognition - Las Vegas, United States
Duration: 26 Jun 20161 Jul 2016
http://cvpr2016.thecvf.com/

Publication series

Name
PublisherIEEE
ISSN (Electronic)1063-6919

Conference

Conference29th IEEE Conference on Computer Vision and Pattern Recognition
Abbreviated titleCVPR 2016
CountryUnited States
CityLas Vegas
Period26/06/161/07/16
Internet address

Keywords

  • computer graphics
  • geometry
  • shape recognition
  • structured prediction
  • unobserved voxels
  • single depth image
  • unambiguous 3D models
  • 3D shape components
  • tabletop-sized objects
  • supervised model
  • indoor object collections
  • challenging real scenes
  • Three-dimensional displays
  • Geometry
  • Shape
  • Solid modeling
  • Two dimensional displays
  • Semantics
  • Cameras

Fingerprint Dive into the research topics of 'Structured Prediction of Unobserved Voxels from a Single Depth Image'. Together they form a unique fingerprint.

Cite this