A proximal gradient algorithm for composite log-concave sampling
Abstract
We propose an algorithm to sample from composite log-concave distributions over ℝd, i.e., densities of the form π∝ e−f−g, assuming access to gradient evaluations of αf-convex f and a restricted Gaussian oracle (RGO) for αg-convex g, where αg ≥ 0. The latter requirement means that we can easily sample from the density RGOg,h,y(x) ∝ exp(−g(x) −1/2h||y−x||2), which is the sampling analogue of the proximal operator for g. If f + g is α-convex and f is β-smooth, our sampler achieves ε error in total variation distance using 𝒪̃(κ√d log4(1/ε)) oracle calls where κ:= 1 ∨ β/α, with 0≤ αg ≤ β and α:= αf + αg > 0, which matches prior state-of-the-art results for the case g=0. We further extend our results to cases where (1) π is non-log-concave but satisfies a Poincaré or log-Sobolev inequality, and (2) f is non-smooth but Lipschitz.
Related
- Reflected Proximal Dynamics for Accelerated High-Accuracy Log-Concave Sampling
- From proximal alternating minimization techniques to composite proximal gradient
- Composite and Stochastic Smoothed Decentralized Bregman Proximal-Gradient Methods
- The Convergence Rate of Accelerated Proximal Gradient Methods with General Inertia Term for Convex Composite Multiobjective Optimization
- Distributed Proximal Stein Variational Gradient Descent Algorithm for Large-scale Bayesian Inference in Traveltime Tomography
BibTeX
@misc{liu2026proximal,
title = {{A proximal gradient algorithm for composite log-concave sampling}},
author = {Linghai Liu and Sinho Chewi},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2605.12461},
eprint = {2605.12461},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2605.12461},
}
RIS
TY - UNPB
TI - A proximal gradient algorithm for composite log-concave sampling
AU - Linghai Liu
AU - Sinho Chewi
PY - 2026
DA - 2026/10/15
PB - arXiv
DO - 10.48550/arxiv.2605.12461
UR - https://arxiv.org/abs/2605.12461
AB - We propose an algorithm to sample from composite log-concave distributions over ℝ^d, i.e., densities of the form π∝ e^−f−g, assuming access to gradient evaluations of α_f-convex f and a restricted Gaussian oracle (RGO) for α_g-convex g, where α_g ≥ 0. The latter requirement means that we can easily sample from the density RGO_g,h,y(x) ∝ exp(−g(x) −1/2h||y−x||^2), which is the sampling analogue of the proximal operator for g. If f + g is α-convex and f is β-smooth, our sampler achieves ε error in total variation distance using 𝒪̃(κ√d log^4(1/ε)) oracle calls where κ:= 1 ∨ β/α, with 0≤ α_g ≤ β and α:= α_f + α_g > 0, which matches prior state-of-the-art results for the case g=0. We further extend our results to cases where (1) π is non-log-concave but satisfies a Poincaré or log-Sobolev inequality, and (2) f is non-smooth but Lipschitz.
ER -