Central limit theorems for high-dimensional ridge regression under uniform subsampling
Abstract
We study ridge regression based on uniformly subsampled observations in high-dimensional linear models, where the number of predictors and the sample size grow proportionally. Subsampling is implemented through independent Bernoulli indicators with a common selection probability. We establish central limit theorems for linear contrasts of the ridge estimator, allowing for non-Gaussian predictors and general population covariance matrices. Under a vanishing-signal assumption, we obtain an explicit bias correction in the isotropic case and develop consistent estimators of the asymptotic variances. These results enable asymptotically valid tests for linear contrasts of the regression parameter in the isotropic setting. Our proofs exploit the resolvent representation of the ridge estimator and combine leave-one-out arguments with deterministic equivalents from random matrix theory.
Related
- Uniform Central Limit Theorems for Degree Distributions of Sparse Graphon Models
- Optimal dimension growth rates in the high dimensional Central Limit Theorems
- Rare-Feature-Adaptive Subsampling for Big Data Regression
- Global central limit theorems for Markov chains
- Global Central Limit Theorems for Markov chains with normal transition operator
BibTeX
@misc{lam2026central,
title = {{Central limit theorems for high-dimensional ridge regression under uniform subsampling}},
author = {Thomas Lam and Nina Dörnemann and Holger Dette},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.38763},
eprint = {2610.38763},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.38763},
}
RIS
TY - UNPB
TI - Central limit theorems for high-dimensional ridge regression under uniform subsampling
AU - Thomas Lam
AU - Nina Dörnemann
AU - Holger Dette
PY - 2026
DA - 2026/10/28
PB - arXiv
DO - 10.48550/arxiv.2610.38763
UR - https://arxiv.org/abs/2610.38763
AB - We study ridge regression based on uniformly subsampled observations in high-dimensional linear models, where the number of predictors and the sample size grow proportionally. Subsampling is implemented through independent Bernoulli indicators with a common selection probability. We establish central limit theorems for linear contrasts of the ridge estimator, allowing for non-Gaussian predictors and general population covariance matrices. Under a vanishing-signal assumption, we obtain an explicit bias correction in the isotropic case and develop consistent estimators of the asymptotic variances. These results enable asymptotically valid tests for linear contrasts of the regression parameter in the isotropic setting. Our proofs exploit the resolvent representation of the ridge estimator and combine leave-one-out arguments with deterministic equivalents from random matrix theory.
ER -