2019
NeurIPS
NeurIPS 2019
Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Suffices
Abstract
We study the Unadjusted Langevin Algorithm (ULA) for sampling from a probability distribution $\nu = e^{-f}$ on $\R^n$. We prove a convergence guarantee in Kullback-Leibler (KL) divergence assuming $\nu$ satisfies log-Sobolev inequality and $f$ has bounded Hessian. Notably, we do not assume convexity or bounds on higher derivatives. We also prove convergence guarantees in R\'enyi divergence of order $q > 1$ assuming the limit of ULA satisfies either log-Sobolev or Poincar\'e inequality.
🌉
Interdisciplinary Bridge
- Artificial Intelligence and Mathematics & Optimization
🐣
Hot Topic Early Bird
- kl divergence
Authors
Topics
Machine Learning > Optimization & Theory > Stochastic Processes
Machine Learning > Optimization & Theory > Theory
Mathematics & Optimization > Optimization > Stochastic Methods
Machine Learning > Bayesian & Probabilistic > Variational Inference
Machine Learning > Bayesian & Probabilistic > Markov Chain Monte Carlo