The correlation-assisted missing data estimator

Timothy Cannings, Yingying Fan

Research output: Contribution to journalArticlepeer-review

Abstract / Description of output

We introduce a novel approach to estimation problems in settings with missing data. Our proposal – the Correlation-Assisted Missing data (CAM) estimator – works by exploiting the relationship between the observations with missing features and those without missing features in order to obtain improved prediction accuracy. In particular, our theoretical results elucidate general conditions under which the proposed CAM estimator has lower mean squared error than the widely used complete-case approach in a range of estimation problems. We showcase in detail how the CAM estimator can be applied to U-Statistics to obtain an unbiased, asymptotically Gaussian estimator that has lower variance than the complete-case U-Statistic. Further, in nonparametric density estimation and regression problems, we construct our CAM estimator using kernel functions, and show it has lower asymptotic mean squared error than the corresponding complete-case kernel estimator. We also include practical demonstrations throughout the paper using simulated data and the Terneuzen birth cohort and Brandsma datasets available from CRAN.
Original languageEnglish
Pages (from-to)1-49
Number of pages49
JournalJournal of Machine Learning Research
Volume23
Issue number41
Publication statusPublished - 3 Feb 2022

Fingerprint

Dive into the research topics of 'The correlation-assisted missing data estimator'. Together they form a unique fingerprint.

Cite this