Training Object Class Detectors from Eye Tracking Data

Dim P. Papadopoulos, Alasdair D.F. Clarke, Frank Keller, Vittorio Ferrari

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Training an object class detector typically requires a large set of images annotated with bounding-boxes, which is expensive and time consuming to create. We propose novel approach to annotate object locations which can substantially reduce annotation time. We first track the eye movements of annotators instructed to find the object and then propose a technique for deriving object bounding-boxes from these fixations. To validate our idea, we collected eye tracking data for the trainval part of 10 object classes of Pascal VOC 2012 (6,270 images, 5 observers). Our technique correctly produces bounding-boxes in 50%of the images, while reducing the total annotation time by factor 6.8× compared to drawing bounding-boxes. Any standard object class detector can be trained on the bounding-boxes predicted by our model. Our large scale eye tracking dataset is available at groups.inf.ed.ac.uk/calvin/eyetrackdataset/ .
Original languageEnglish
Title of host publicationComputer Vision – ECCV 2014
Subtitle of host publication13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V
PublisherSpringer
Pages361-376
Number of pages16
ISBN (Electronic)978-3-319-10602-1
ISBN (Print)978-3-319-10601-4
DOIs
Publication statusPublished - 12 Sept 2014
EventEuropean Conference on Computer Vision 2014 - Zurich, Switzerland
Duration: 5 Sept 201412 Sept 2014

Publication series

NameLecture Notes in Computer Science
Volume8693
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceEuropean Conference on Computer Vision 2014
Abbreviated titleECCV 2014
Country/TerritorySwitzerland
CityZurich
Period5/09/1412/09/14

Fingerprint

Dive into the research topics of 'Training Object Class Detectors from Eye Tracking Data'. Together they form a unique fingerprint.

Cite this