Efficient Mass Matrix Estimation with Gaussian Cooling
Abstract
We introduce an algorithm for efficiently preconditioning log-concave and log-smooth distributions that scales logarithmically with the condition number of the underlying distribution. Based on Gaussian cooling, our multistage method approximately samples from a sequence of well-conditioned distributions to construct a preconditioner for each subsequent stage of the cooling schedule. This method is motivated by existing practical approaches for mass matrix estimation in Markov chain Monte Carlo (MCMC), in which an effective preconditioner for the target distribution is estimated from samples produced during a warm-up period. However, our approach is conceptually distinct from existing approaches and moreover permits theoretical analysis. Our algorithmic framework is flexible, allowing essentially any log-concave sampling algorithm to act as the subroutine within each cooling stage. For instance, using first-order rejection sampling (FORS) as the sampler, the first-order query complexity of our method is Õ(d4/3 log κ) for a large class of log-concave and log-smooth distributions with condition number κ and Õ(d1/3 log κ) for translation-invariant distributions. In the translation-invariant setting, we provide numerical experiments for the lattice ϕ4 model, a simple lattice field theory.
Related
- Efficient estimation methods for non-Gaussian regression models in continuous time
- Wrench-Based Bayesian Pose Estimation via Matrix--Fisher Gaussian Inference
- Efficient Deep Gaussian Process Surrogates via Mini-Batch Latent MAP Estimation
- Thin-shell stability of Gaussian cooling: logconcave sampling with sesteric complexity from a cold start
- A candidate proof of the sharp Latala and Strzelecka Gaussian matrix bound
BibTeX
@misc{hofgard2026efficient,
title = {{Efficient Mass Matrix Estimation with Gaussian Cooling}},
author = {Jake Hofgard and Michael Lindsey},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.04806},
eprint = {2610.04806},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.04806},
}
RIS
TY - UNPB
TI - Efficient Mass Matrix Estimation with Gaussian Cooling
AU - Jake Hofgard
AU - Michael Lindsey
PY - 2026
DA - 2026/10/03
PB - arXiv
DO - 10.48550/arxiv.2610.04806
UR - https://arxiv.org/abs/2610.04806
AB - We introduce an algorithm for efficiently preconditioning log-concave and log-smooth distributions that scales logarithmically with the condition number of the underlying distribution. Based on Gaussian cooling, our multistage method approximately samples from a sequence of well-conditioned distributions to construct a preconditioner for each subsequent stage of the cooling schedule. This method is motivated by existing practical approaches for mass matrix estimation in Markov chain Monte Carlo (MCMC), in which an effective preconditioner for the target distribution is estimated from samples produced during a warm-up period. However, our approach is conceptually distinct from existing approaches and moreover permits theoretical analysis. Our algorithmic framework is flexible, allowing essentially any log-concave sampling algorithm to act as the subroutine within each cooling stage. For instance, using first-order rejection sampling (FORS) as the sampler, the first-order query complexity of our method is Õ(d^4/3 log κ) for a large class of log-concave and log-smooth distributions with condition number κ and Õ(d^1/3 log κ) for translation-invariant distributions. In the translation-invariant setting, we provide numerical experiments for the lattice ϕ^4 model, a simple lattice field theory.
ER -