Improving Prediction from Dirichlet Process Mixtures via Enrichment

Sara Wade, David B. Dunson, Sonia Petrone, Lorenzo Trippa

Research output: Contribution to journalArticlepeer-review

Abstract

Flexible covariate-dependent density estimation can be achieved by modelling the joint density of the response and covariates as a Dirichlet process mixture. An appealing aspect of this approach is that computations are relatively easy. In this paper, we examine the predictive performance of these models with an increasing number of covariates. Even for a moderate number of covariates, we find that the likelihood for x tends to dominate the posterior of the latent random partition, degrading the predictive performance of the model. To overcome this, we suggest using a different nonparametric prior, namely an enriched Dirichlet process. Our proposal maintains a simple allocation rule, so that computations remain relatively simple. Advantages are shown through both predictive equations and examples, including an application to diagnosis Alzheimer's disease.
Original languageEnglish
Pages (from-to)1041-1071
Number of pages31
JournalJournal of Machine Learning Research
Volume15
Publication statusPublished - Mar 2014

Fingerprint

Dive into the research topics of 'Improving Prediction from Dirichlet Process Mixtures via Enrichment'. Together they form a unique fingerprint.

Cite this