Abstract / Description of output
We develop an inverse graphics approach to the problem of scene understanding, obtaining a rich representation that includes descriptions of the objects in the scene and their spatial layout, as well as global latent variables like the camera parameters and lighting. The framework’s stages include object detection, the prediction of the camera and lighting variables, and prediction of object-specific variables (shape, appearance and pose). This acts like the encoder of an autoencoder, with graphics rendering as the decoder. Importantly the scene representation is interpretable and is of variable dimension to match the detected number of objects plus the global variables. For the prediction of the camera latent variables we introduce a novel architecture termed Probabilistic HoughNets (PHNs), which provides a principled approach to combining information from multiple detections. We demonstrate the quality of the reconstructions obtained quantitatively on synthetic data, and qualitatively on real scenes.
Original language | English |
---|---|
Title of host publication | ICCV 2017 Workshop on Geometry Meets Deep Learning |
Publisher | Institute of Electrical and Electronics Engineers |
Pages | 940-948 |
Number of pages | 9 |
ISBN (Electronic) | 978-1-5386-1034-3 |
ISBN (Print) | 978-1-5386-1035-0 |
DOIs | |
Publication status | Published - 23 Jan 2018 |
Event | Geometry Meets Deep Learning ICCV 2017 Workshop - Palazzo del Cinema, Venice, Italy Duration: 28 Oct 2017 → 28 Oct 2017 https://sites.google.com/site/deepgeometry2017/home |
Publication series
Name | |
---|---|
Publisher | IEEE |
ISSN (Electronic) | 2473-9944 |
Conference
Conference | Geometry Meets Deep Learning ICCV 2017 Workshop |
---|---|
Country/Territory | Italy |
City | Venice |
Period | 28/10/17 → 28/10/17 |
Internet address |