Sampling from a Log-Concave Distribution with Projected Langevin Monte Carlo
Sébastien Bubecka b, Ronen Eldanc d✉, Joseph Lehece f
- aMicrosoft Research, Redmond, WA, 98052, USA
- bMicrosoft Research, , Redmond, USA#TAB#
- cFaculty of Mathematics and Computer Science, The Weizmann Institute of Science, 7610001, Rehovot, Israel
- d[Faculty of Mathematics and Computer Science, The Weizmann Institute of Science, Rehovot, Israel]
- eCEREMADE, Université Paris-Dauphine, 75016, Paris, France
- fCeremade, Université Paris Dauphine, Paris, France
- ✉Corresponding author
Papers open inside SciRah from the original publisher or repository; SciRah never hosts them.
Abstract
We extend the Langevin Monte Carlo (LMC) algorithm to compactly supported measures via a projection step, akin to projected stochastic gradient descent (SGD). We show that (projected) LMC allows to sample in polynomial time from a log-concave distribution with smooth potential. This gives a new Markov chain to sample from a log-concave distribution. Our main result shows in particular that when the target distribution is uniform, LMC mixes in O~(n7)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\widetilde{O}(n^7)$$\end{document} steps (where n is the dimension). We also provide preliminary experimental evidence that LMC performs at least as well as hit-and-run, for which a better mixing time of O~(n4)\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\widetilde{O}(n^4)$$\end{document} was proved by Lovász and Vempala.
TL;DRThe Langevin Monte Carlo algorithm is extended to compactly supported measures via a projection step, akin to projected stochastic gradient descent (SGD), and (projected) LMC allows to sample in polynomial time from a log-concave distribution with smooth potential. (Semantic Scholar)

