2011
NIPS
NeurIPS 2011
Accelerated Adaptive Markov Chain for Partition Function Computation
Abstract
We propose a novel Adaptive Markov Chain Monte Carlo algorithm to compute the partition function. In particular, we show how to accelerate a flat histogram sampling technique by significantly reducing the number of ``null moves'' in the chain, while maintaining asymptotic convergence properties. Our experiments show that our method converges quickly to highly accurate solutions on a range of benchmark instances, outperforming other state-of-the-art methods such as IJGP, TRW, and Gibbs sampling both in run-time and accuracy. We also show how obtaining a so-called density of states distribution allows for efficient weight learning in Markov Logic theories.
🌉
Interdisciplinary Bridge
— Machine Learning and Mathematics & Optimization
🧭
Keyword Pioneer
— flat histogram sampling
🐣
Hot Topic Early Bird
— markov chain monte carlo
🐝
Cross-Pollinator
— Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Security & Privacy, Speech & Audio
📈
Trend Setter
— Stochastic Processes
Authors
Topics
Machine Learning > Optimization & Theory > Bayesian Inference
Machine Learning > Optimization & Theory > Stochastic Processes
Mathematics & Optimization > Optimization > Stochastic Methods
Mathematics & Optimization > Probability > Stochastic Processes
Machine Learning > Bayesian & Probabilistic > Markov Chain Monte Carlo
Machine Learning > Core Methods > Sampling