Estimation of multiple mean vectors in high dimension
Abstract
We endeavour to estimate numerous multi-dimensional means of various probability distributions on a common space based on independent samples. Our approach involves forming estimators through convex combinations of empirical means derived from these samples. We introduce two strategies to find appropriate data-dependent convex combination weights: a first one employing a testing procedure to identify neighbouring means with low variance, which results in a closed-form plug-in formula for the weights, and a second one determining weights via minimization of an upper confidence bound on the quadratic risk. Through theoretical analysis, we evaluate the improvement in quadratic risk offered by our methods compared to the empirical means. Our analysis focuses on a dimensional asymptotics perspective, showing that our methods asymptotically approach an oracle (minimax) improvement as the effective dimension of the data increases. We demonstrate the efficacy of our methods in estimating multiple kernel mean embeddings through experiments on both simulated and real-world datasets.
Related
- Linking Error Estimation for Mean-Geometric Mean and Pairwise Haberman Linking Across Multiple Time Points in the 2PL Model
- Markovian renormalisation for percolation in high-dimension: Semi-decidability of mean field behavior
- Robust variance estimation for multiple imputation using predictive mean matching or parametric imputation models
- Multiple Change Point Detection in the Mean and Covariance of High-Dimensional Matrix Time Series
- Hausdorff Dimension of Weighted Singular Vectors
BibTeX
@misc{blanchard2026estimation,
title = {{Estimation of multiple mean vectors in high dimension}},
author = {Gilles Blanchard and Jean-Baptiste Fermanian and Hannah Marienwald},
howpublished = {HAL},
year = {2026},
month = sep,
eprint = {2403.15038},
archivePrefix = {arXiv},
url = {https://hal.science/hal-04515801v3},
note = {CC BY-NC-ND 4.0},
}
RIS
TY - UNPB
TI - Estimation of multiple mean vectors in high dimension
AU - Gilles Blanchard
AU - Jean-Baptiste Fermanian
AU - Hannah Marienwald
PY - 2026
DA - 2026/09/16
PB - HAL
UR - https://hal.science/hal-04515801v3
AB - We endeavour to estimate numerous multi-dimensional means of various probability distributions on a common space based on independent samples. Our approach involves forming estimators through convex combinations of empirical means derived from these samples. We introduce two strategies to find appropriate data-dependent convex combination weights: a first one employing a testing procedure to identify neighbouring means with low variance, which results in a closed-form plug-in formula for the weights, and a second one determining weights via minimization of an upper confidence bound on the quadratic risk. Through theoretical analysis, we evaluate the improvement in quadratic risk offered by our methods compared to the empirical means. Our analysis focuses on a dimensional asymptotics perspective, showing that our methods asymptotically approach an oracle (minimax) improvement as the effective dimension of the data increases. We demonstrate the efficacy of our methods in estimating multiple kernel mean embeddings through experiments on both simulated and real-world datasets.
ER -