On the asymptotic behaviour of α-divergence generalized posteriors
Abstract
We study the asymptotic behaviour of the solutions to the unconstrained generalized variational inference problem regularized by an α-divergence. Under mild conditions, the minimizer is explicit up to a scalar normalizing constant, and we show that it admits a rescaling under which it converges in L1 to a fixed non-Gaussian law, at a concentration scale around the empirical loss minimizer that departs from the typical n−1/2 in the classical Bernstein--von Mises theorem. For α∈(0,1) and d<2/(1−α) the limit is a Student-t distribution and the posterior width shrinks faster than the sampling error of the empirical minimizer. Conversely, for α>1 the limiting distribution is a compactly supported Pearson type-II distribution, and the posterior width shrinks more slowly than the sampling error. The KL divergence (α=1) is the unique member of the α-divergence family whose posterior width matches the sampling scale and whose limit is Gaussian. We discuss the implications of these qualitatively different regimes for the frequentist coverage of credible regions, and a toy example on intercept-only logistic regression illustrates the theoretical claims.
Related
- Fast Calibration of Generalized Posteriors via Dirichlet Reweighting
- Computationally Efficient Experimental Design with Generalized Posteriors
- Efficient Bootstrap Calibration of Generalized Posteriors with Importance Reweighting
- Asymptotic behaviour of the v-number of homogeneous ideals
- Boundary Blowup Solutions for the Finsler p-Laplacian: Wellposedness and Asymptotic Behaviour
BibTeX
@misc{casadotelletxea2026asymptotic,
title = {{On the asymptotic behaviour of $α$-divergence generalized posteriors}},
author = {Ioar Casado-Telletxea and Omar Rivasplata},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.35330},
eprint = {2610.35330},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.35330},
note = {CC BY-NC-ND 4.0},
}
RIS
TY - UNPB
TI - On the asymptotic behaviour of α-divergence generalized posteriors
AU - Ioar Casado-Telletxea
AU - Omar Rivasplata
PY - 2026
DA - 2026/10/26
PB - arXiv
DO - 10.48550/arxiv.2610.35330
UR - https://arxiv.org/abs/2610.35330
AB - We study the asymptotic behaviour of the solutions to the unconstrained generalized variational inference problem regularized by an α-divergence. Under mild conditions, the minimizer is explicit up to a scalar normalizing constant, and we show that it admits a rescaling under which it converges in L^1 to a fixed non-Gaussian law, at a concentration scale around the empirical loss minimizer that departs from the typical n^−1/2 in the classical Bernstein--von Mises theorem. For α∈(0,1) and d<2/(1−α) the limit is a Student-t distribution and the posterior width shrinks faster than the sampling error of the empirical minimizer. Conversely, for α>1 the limiting distribution is a compactly supported Pearson type-II distribution, and the posterior width shrinks more slowly than the sampling error. The KL divergence (α=1) is the unique member of the α-divergence family whose posterior width matches the sampling scale and whose limit is Gaussian. We discuss the implications of these qualitatively different regimes for the frequentist coverage of credible regions, and a toy example on intercept-only logistic regression illustrates the theoretical claims.
ER -