Diverse Ensembles Improve Calibration

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a simple technique to improve calibration, using a different data augmentation for each ensemble member. We additionally use the idea of ‘mixing’unaugmented and augmented inputs to improve calibration when test and training distributions are the same. These simple techniques improve calibration and accuracy over strong baselines on the CIFAR10 and CIFAR100 benchmarks, and out-of-domain data from their corrupted versions.
Original languageEnglish
Title of host publicationICML 2020 Workshop on Uncertainty and Robustness in Deep Learning
Number of pages6
Publication statusAccepted/In press - 1 Jul 2020
EventICML 2020 Workshop on Uncertainty & Robustness in Deep Learning - Virtual workshop
Duration: 17 Jul 202017 Jul 2020
https://sites.google.com/view/udlworkshop2020/home?authuser=0

Workshop

WorkshopICML 2020 Workshop on Uncertainty & Robustness in Deep Learning
Abbreviated titleICML UDL 2020
CityVirtual workshop
Period17/07/2017/07/20
Internet address

Fingerprint Dive into the research topics of 'Diverse Ensembles Improve Calibration'. Together they form a unique fingerprint.

Cite this