Information theoretic novelty detection

Maurizio Filippone, Guido Sanguinetti

Research output: Contribution to journalArticlepeer-review


We present a novel approach to online change detection problems when the training sample size is small. The proposed approach is based on estimating the expected information content of a new data point and allows an accurate control of the false positive rate even for small data sets. In the case of the Gaussian distribution, our approach is analytically tractable and closely related to classical statistical tests. We then propose an approximation scheme to extend our approach to the case of the mixture of Gaussians. We evaluate extensively our approach on synthetic data and on three real benchmark data sets. The experimental validation shows that our method maintains a good overall accuracy, but significantly improves the control over the false positive rate.
Original languageEnglish
Pages (from-to)805 - 814
Number of pages10
JournalPattern Recognition
Issue number3
Publication statusPublished - 2010


  • Density estimation


Dive into the research topics of 'Information theoretic novelty detection'. Together they form a unique fingerprint.

Cite this