STUN: Self-Teaching Uncertainty Estimation for Place Recognition

Kaiwen Cai, Chris Xiaoxuan Lu, Xiaowei Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

Place recognition is key to Simultaneous Localization and Mapping (SLAM) and spatial perception. However, a place recognition in the wild often suffers from erroneous predictions due to image variations, e.g., changing viewpoints and street appearance. Integrating uncertainty estimation into the life cycle of place recognition is a promising method to mitigate the impact of variations on place recognition performance. However, existing uncertainty estimation approaches in this vein are either computationally inefficient (e.g., Monte Carlo dropout) or at the cost of dropped accuracy. This paper proposes STUN, a self-teaching framework that learns to simultaneously predict the place and estimate the prediction uncertainty given an input image. To this end, we first train a teacher net using a standard metric learning pipeline to produce embedding priors. Then, supervised by the pretrained teacher net, a student net with an additional variance branch is trained to finetune the embedding priors and estimate the uncertainty sample by sample. During the online inference phase, we only use the student net to generate a place prediction in conjunction with the uncertainty. When compared with place recognition systems that are ignorant of the uncertainty, our framework features the uncertainty estimation for free without sacrificing any prediction accuracy. Our experimental results on the large-scale Pittsburgh30k dataset demonstrate that STUN outperforms the state-of-the-art methods in both recognition accuracy and the quality of uncertainty estimation.
Original languageEnglish
Title of host publicationProceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2022
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Number of pages8
ISBN (Electronic)978-1-6654-7927-1
ISBN (Print)978-1-6654-7928-8
Publication statusPublished - 26 Dec 2022
EventThe 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems - Kyoto, Japan
Duration: 23 Oct 202227 Oct 2022

Publication series

NameIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
ISSN (Print)2153-0858
ISSN (Electronic)2153-0866


ConferenceThe 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems
Abbreviated titleIROS 2022
Internet address


Dive into the research topics of 'STUN: Self-Teaching Uncertainty Estimation for Place Recognition'. Together they form a unique fingerprint.

Cite this