← Back to papers
2006 NIPS NeurIPS 2006

A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation

Abstract

Latent Dirichlet allocation (LDA) is a Bayesian network that has recently gained much popularity in applications ranging from document modeling to computer vision. Due to the large scale nature of these applications, current inference pro- cedures like variational Bayes and Gibbs sampling have been found lacking. In this paper we propose the collapsed variational Bayesian inference algorithm for LDA, and show that it is computationally efficient, easy to implement and signifi- cantly more accurate than standard variational Bayesian inference for LDA.

🚀 Conference Pioneer — NIPS 2006
🌉 Interdisciplinary Bridge — Artificial Intelligence and Deep Learning and Machine Learning
📈 Trend Setter — Variational Inference
🧭 Keyword Pioneer — collapsed variational bayes
🐣 Hot Topic Early Bird — variational inference
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Speech & Audio
🌱 Topic Pioneer — Topic Modeling

Authors

Yee W. Teh , David Newman , Max Welling

Topics

Artificial Intelligence > Bayesian & Probabilistic > Bayesian Learning Artificial Intelligence > Bayesian & Probabilistic > Probabilistic Modeling Machine Learning > Core Methods > Clustering Machine Learning > Optimization & Theory > Bayesian Inference Deep Learning > Models > Variational Inference Machine Learning > Core Methods > Probabilistic Modeling Natural Language Processing > Resources & Methods > Language Modeling Machine Learning > Bayesian & Probabilistic > Bayesian Inference Machine Learning > Bayesian & Probabilistic > Variational Inference Natural Language Processing > Applications > Topic Modeling

Keywords

probabilistic modeling variational inference collapsed variational bayes latent dirichlet allocation topic modeling variational bayesian variational bayesian inference collapsed variational inference bayesian network probabilistic model topic model collapsed inference
Download PDF

Related papers

Temporal Coding using the Response Properties of Spiking Neurons 2006
Parameter Expanded Variational Bayesian Methods 2006
Effects of Stress and Genotype on Meta-parameter Dynamics in Reinforcement Learning 2006
Ordinal Regression by Extended Binary Classification 2006
Blind source separation for over-determined delayed mixtures 2006