PreprintCC BY 4.0arXiv
Optimal Linear Functional Estimation for Proportionally High-Dimensional Linear Models
Abstract
We study estimation of a linear functional in random-design linear models when γ=p/n ∈ (1, ∞) under the dense regime where the design covariance is unknown, and neither the regression vector nor the precision matrix is assumed sparse. Suppose the spectrum of the design covariance belongs to [ℓ,L], we establish the minimax mean squared rate for the linear functional has the order n−α(κ,γ), where the exponent α(κ,γ) has an explicit elliptic-integral representation and α(κ,γ) < 1 when both κ> 1 and γ> 1. We propose the Bocca estimator, which combines empirically calibrated resolvents through a complex contour integral to attain the optimal rate.
Related
- Optimal estimation for Functional Linear Regression with Noisy Discretized Data
- Optimal Neural Estimation for High-Dimensional Nonparametric Regression under Multisource Covariate Shift
- Optimal estimation and goodness-of-fit testing of the mean for sparse longitudinal functional data
- Large-scale linear hypothesis testing for high-dimensional online M-estimation
- A Newton--Kleinman Iteration for Infinite-Dimensional Linear-Quadratic Optimal Control
BibTeX
@misc{lu2026optimal,
title = {{Optimal Linear Functional Estimation for Proportionally High-Dimensional Linear Models}},
author = {Junwei Lu},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.06875},
eprint = {2610.06875},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.06875},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Optimal Linear Functional Estimation for Proportionally High-Dimensional Linear Models
AU - Junwei Lu
PY - 2026
DA - 2026/10/01
PB - arXiv
DO - 10.48550/arxiv.2610.06875
UR - https://arxiv.org/abs/2610.06875
AB - We study estimation of a linear functional in random-design linear models when γ=p/n ∈ (1, ∞) under the dense regime where the design covariance is unknown, and neither the regression vector nor the precision matrix is assumed sparse. Suppose the spectrum of the design covariance belongs to [ℓ,L], we establish the minimax mean squared rate for the linear functional has the order n^−α(κ,γ), where the exponent α(κ,γ) has an explicit elliptic-integral representation and α(κ,γ) < 1 when both κ> 1 and γ> 1. We propose the Bocca estimator, which combines empirically calibrated resolvents through a complex contour integral to attain the optimal rate.
ER -