Joint Calibration for Semantic Segmentation

Holger Caesar, Jasper Uijlings, Vittorio Ferrari

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Semantic segmentation is the task of assigning a class-label to each pixel in an image. We propose a region-based semantic segmentation framework which handles both full and weak supervision, and addresses three common problems: (1) Objects occur at multiple scales and therefore we should use regions at multiple scales. However, these regions are overlapping which creates conflicting class predictions at the pixel-level. (2) Class frequencies are highly imbalanced in realistic datasets. (3) Each pixel can only be assigned to a single class, which creates competition between classes. We address all three problems with a joint calibration method which optimizes a multi-class loss defined over the final pixel-level output labeling, as opposed to simply region classification. Our method outperforms the state-of-the-art on the popular SIFT Flow [17] dataset in both the fully and weakly supervised setting.
Original languageEnglish
Title of host publicationBritish Machine Vision Conference 2015
PublisherBMVA Press
Number of pages13
ISBN (Print)1-901725-53-7
Publication statusPublished - Sep 2015

Fingerprint

Dive into the research topics of 'Joint Calibration for Semantic Segmentation'. Together they form a unique fingerprint.

Cite this