Co-sufficient weighting: leveraging sparsity for more powerful variable selection in the linear model
Abstract
We show that for the problem of controlled variable selection in the Gaussian linear model, informative and p-value-independent weights (for weighted multiple testing) can be derived entirely from sufficient statistics and a belief in sparsity using only the data itself and no external quantitative side information. Using these weights, which we call \emph{co-sufficient weights} (CSW), in weighted versions of Holm's procedure and the Benjamini--Hochberg (BH) procedure results in substantially higher power than their unweighted analogues when the true coefficient vector is sparse, while retaining Holm's exact validity and BH's highly robust empirical validity regardless of sparsity. We demonstrate the superior performance of our proposed weighted methods compared to their unweighted analogues and other competing methods in a wide range of simulations and an application to HIV drug resistance.
Related
- TwinPoSI: Statistical Twins for Powerful Post-Selection Inference on Population-Based Regression Coefficients
- Sparsity Regularized and Robust Mean Variance Portfolio Selection Under Ellipsoidal Uncertainty
- Sparsity by Default: The Theory and Practice of ARD in Gaussian Process Regression for Variable Selection
- Task-Sufficient Contraction: Source Selection for Machine Information Interfaces
- Sparsity of Quadratically Regularized Optimal Transport: Scalar Case
BibTeX
@misc{sengupta2026cosufficient,
title = {{Co-sufficient weighting: leveraging sparsity for more powerful variable selection in the linear model}},
author = {Souhardya Sengupta and Lucas Janson},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.42122},
eprint = {2610.42122},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.42122},
}
RIS
TY - UNPB
TI - Co-sufficient weighting: leveraging sparsity for more powerful variable selection in the linear model
AU - Souhardya Sengupta
AU - Lucas Janson
PY - 2026
DA - 2026/10/30
PB - arXiv
DO - 10.48550/arxiv.2610.42122
UR - https://arxiv.org/abs/2610.42122
AB - We show that for the problem of controlled variable selection in the Gaussian linear model, informative and p-value-independent weights (for weighted multiple testing) can be derived entirely from sufficient statistics and a belief in sparsity using only the data itself and no external quantitative side information. Using these weights, which we call \emph{co-sufficient weights} (CSW), in weighted versions of Holm's procedure and the Benjamini--Hochberg (BH) procedure results in substantially higher power than their unweighted analogues when the true coefficient vector is sparse, while retaining Holm's exact validity and BH's highly robust empirical validity regardless of sparsity. We demonstrate the superior performance of our proposed weighted methods compared to their unweighted analogues and other competing methods in a wide range of simulations and an application to HIV drug resistance.
ER -