A Note on the Implementation of Hierarchical Dirichlet Processes

Phil Blunsom, Trevor Cohn, Sharon Goldwater, Mark Johnson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

The implementation of collapsed Gibbs samplers for non-parametric Bayesian models is non-trivial, requiring con-siderable book-keeping. Goldwater et al. (2006a) presented an approximation which significantly reduces the storage and computation overhead, but we show here that their formulation was incorrect and, even after correction, is grossly inaccurate. We present an alternative formulation which is exact and can be computed easily. However this approach does not work for hierarchical models, for which case we present an efficient data structure which has a better space complexity than the naive approach.
Original languageEnglish
Title of host publicationProceedings of the ACL-IJCNLP 2009 Conference Short Papers
Place of PublicationSuntec, Singapore
PublisherAssociation for Computational Linguistics
Number of pages4
Publication statusPublished - 1 Aug 2009


Dive into the research topics of 'A Note on the Implementation of Hierarchical Dirichlet Processes'. Together they form a unique fingerprint.

Cite this