Practical Identifiability of Finite Mixtures of Multivariate Bernoulli Distributions

Miguel Á Carreira-Perpiñán, Steve Renals

Research output: Contribution to journalArticlepeer-review

Abstract

The class of finite mixtures of multivariate Bernoulli distributions is known to be nonidentifiable; that is, different values of the mixture parameters can correspond to exactly the same probability distribution. In principle, this would mean that sample estimates using this model would give rise to different interpretations. We give empirical support to the fact that estimation of this class of mixtures can still produce meaningful results in practice, thus lessening the importance of the identifiability problem. We also show that the expectation-maximization algorithm is guaranteed to converge to a proper maximum likelihood estimate, owing to a property of the log-likelihood surface. Experiments with synthetic data sets show that an original generating distribution can be estimated from a sample. Experiments with an electropalatography data set show important structure in the data.
Original languageEnglish
Pages (from-to)141-152
Number of pages12
JournalNeural Computation
Volume12
Issue number1
DOIs
Publication statusPublished - 1 Jan 2000

Fingerprint

Dive into the research topics of 'Practical Identifiability of Finite Mixtures of Multivariate Bernoulli Distributions'. Together they form a unique fingerprint.

Cite this