Posterior-based proposals for speeding up Markov chain Monte Carlo

Christopher Pooley, Steve C. Bishop, Andrea Wilson, Glenn Marion

Research output: Contribution to journalArticlepeer-review

Abstract / Description of output

Markov chain Monte Carlo (MCMC) is widely used for Bayesian inference in models of complex systems. Performance, however, is often unsatisfactory in models with many latent variables due to so-called poor mixing, necessitating development of application specific implementations. This paper introduces “posterior-based proposals” (PBPs), a new type of MCMC update applicable to a huge class of statistical models (whose conditional dependence structures are represented by directed acyclic graphs). PBPs generates large joint updates in parameter and latent variable space, whilst retaining good acceptance rates (typically 33%). Evaluation against other approaches (from standard Gibbs / random walk updates to state-of-the-art Hamiltonian and particle MCMC methods) was carried out for widely varying model types: an individual-based model for disease diagnostic test data, a financial stochastic volatility model, a mixed model used in statistical genetics and a population model used in ecology. Whilst different methods worked better or worse in different scenarios, PBPs were found to be either near to the fastest or significantly faster than the next best approach (by up to a factor of 10). PBPs therefore represent an additional general purpose technique that can be usefully applied in a wide variety of contexts.
Original languageEnglish
JournalRoyal Society Open Science
Early online date20 Nov 2019
DOIs
Publication statusE-pub ahead of print - 20 Nov 2019

Keywords / Materials (for Non-textual outputs)

  • Posterior-based proposal
  • Markov chain Monte Carlo
  • Bayesian inference
  • mixed model
  • stochastic volatility
  • statistical genetics

Fingerprint

Dive into the research topics of 'Posterior-based proposals for speeding up Markov chain Monte Carlo'. Together they form a unique fingerprint.

Cite this