ForgetMeNot: Memory-Aware Forensic Facial Sketch Matching

Shuxin Ouyang, Timothy Hospedales, Yi-Zhe Song, Xueming Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We investigate whether it is possible to improve the performance of automated facial forensic sketch matching by learning from examples of facial forgetting over time. Forensic facial sketch recognition is a key capability for law enforcement, but remains an unsolved problem. It is extremely challenging because there are three distinct contributors to the domain gap between forensic sketches and photos: The well-studied sketch-photo modality gap, and the less studied gaps due to (i) the forgetting process of the eye-witness and (ii) their inability to elucidate their memory. In this paper, we address the memory problem head on y introducing a database of 400 forensic sketches created at different time-delays. Based on this database we build a model to reverse the forgetting process. Surprisingly, we show that it is possible to systematically “un-forget” facial details. Moreover, it is possible to apply this model to dramatically improve forensic sketch recognition in practice: we achieve the state of the art results when matching 195 benchmark forensic sketches against corresponding photos and a 10,030 mugshot database.
Original languageEnglish
Title of host publicationComputer Vision and Pattern Recognition (CVPR), 2016 IEEE Conference on
PublisherInstitute of Electrical and Electronics Engineers
Pages5571-5579
Number of pages9
ISBN (Electronic)978-1-4673-8851-1
ISBN (Print) 978-1-4673-8852-8
DOIs
Publication statusPublished - 12 Dec 2016
Event29th IEEE Conference on Computer Vision and Pattern Recognition - Las Vegas, United States
Duration: 26 Jun 20161 Jul 2016
http://cvpr2016.thecvf.com/

Conference

Conference29th IEEE Conference on Computer Vision and Pattern Recognition
Abbreviated titleCVPR 2016
Country/TerritoryUnited States
CityLas Vegas
Period26/06/161/07/16
Internet address

Fingerprint

Dive into the research topics of 'ForgetMeNot: Memory-Aware Forensic Facial Sketch Matching'. Together they form a unique fingerprint.

Cite this