Precise Asymptotics for Dense High-Dimensional Huber Regression under Heteroscedasticity
Abstract
We study Huber regression in a heteroscedastic linear model in the proportional regime n/p → δ∈ (1, ∞). Our main result is an exact characterization of the asymptotic empirical distribution of the Huber estimator. This characterization is in terms of three scalar parameters which determine the first-order centre and the asymptotic variance of the Huber estimator. The result shows that with heteroscedastic noise, the first-order centre may contain an additional component along the variance index coefficient. We derive the displacement coefficients that determine this centre, as well as the exact asymptotic variance. The analysis uses the matrix approximate message passing (AMP) framework to jointly track the regression and variance index coefficients, extending the existing framework for homoscedastic M-estimators. We illustrate the implications of this characterization by constructing a test for centre displacement and examining its empirical size and power through simulations.
Related
- Influence Diagnostics in High-dimensional M-estimation: Precise Asymptotics
- A Copula-Based Regression Framework for Enhanced Prediction under Heteroscedasticity
- Three-group variance-ratio tests for heteroscedasticity in linear regression: an exact null distribution and an outlier-resistant version
- Precise universal edge asymptotics for planar β=2 Coulomb gases with radial external fields
- Phylogenetic Inference and the Stickiness of Fréchet Means, via Precise Asymptotics of an Embedded Random Walk
BibTeX
@misc{zhou2026precise,
title = {{Precise Asymptotics for Dense High-Dimensional Huber Regression under Heteroscedasticity}},
author = {Jing Zhou and Ramji Venkataramanan and Hui Zou},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.20798},
eprint = {2610.20798},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.20798},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Precise Asymptotics for Dense High-Dimensional Huber Regression under Heteroscedasticity
AU - Jing Zhou
AU - Ramji Venkataramanan
AU - Hui Zou
PY - 2026
DA - 2026/10/14
PB - arXiv
DO - 10.48550/arxiv.2610.20798
UR - https://arxiv.org/abs/2610.20798
AB - We study Huber regression in a heteroscedastic linear model in the proportional regime n/p → δ∈ (1, ∞). Our main result is an exact characterization of the asymptotic empirical distribution of the Huber estimator. This characterization is in terms of three scalar parameters which determine the first-order centre and the asymptotic variance of the Huber estimator. The result shows that with heteroscedastic noise, the first-order centre may contain an additional component along the variance index coefficient. We derive the displacement coefficients that determine this centre, as well as the exact asymptotic variance. The analysis uses the matrix approximate message passing (AMP) framework to jointly track the regression and variance index coefficients, extending the existing framework for homoscedastic M-estimators. We illustrate the implications of this characterization by constructing a test for centre displacement and examining its empirical size and power through simulations.
ER -