Learning-Enabled Estimation: Tight Characterizations under Sample Selection Biases
Abstract
When can we learn from biased samples? We study regression when outcomes are observed only after passing through selection filters that depend on both covariates and outcomes themselves, a ubiquitous challenge spanning clinical trials with patient dropout, labor markets with self-selection, and auctions with strategic entry. Ignoring such selection yields systematically biased conclusions with real-world consequences. This challenge has a long history in econometrics and statistics, starting with Heckman's seminal two-stage model and followed by numerous generalizations. While these works provide various sufficient conditions for identification, a complete characterization of when such regression is possible has remained elusive. In this work, we provide a characterization for when regression is possible in the presence of sample selection bias. Our results establish the minimal assumptions required on the functional forms of selection processes under which regression remains possible, which are particularly relevant in modern settings where selection mechanisms are increasingly complex and opaque. As a corollary of our characterization, we show that there are settings where the regression function can be identified even when the selection filter itself cannot. This observation already goes beyond the ``estimate selection filter, then debias regression'' paradigm that is followed by virtually all existing approaches. Under natural strengthenings of our identification conditions, we also establish finite-sample estimation guarantees with explicit convergence rates and provide oracle-efficient algorithms. This yields the first general-purpose estimation method for this broad class of selection problems. Finally, we explore the implications of our results for several well-studied econometric settings with complex selection mechanisms such as auctions with entry costs and labor markets.
Related
- When n is not enough: Assessing the interplay of spatial sampling error and sample selection in abundance estimation
- Mutual Information Estimation via Triangular Transport Maps: Finite Sample Guarantees and Sample Allocation
- A statistical theory for blind denoising: minimax estimation of the noise level from a single sample
- Error analysis and optimal sample allocation for randomized unbiased estimation: the single term estimator
- A Nonconvex Framework for Joint Sparse Sample Weighting and Parameter Estimation
BibTeX
@misc{kher2026learningenabled,
title = {{Learning-Enabled Estimation: Tight Characterizations under Sample Selection Biases}},
author = {Vikram Kher and Jane H. Lee and Anay Mehrotra and Manolis Zampetakis},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.38608},
eprint = {2609.38608},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.38608},
note = {CC BY-NC-SA 4.0},
}
RIS
TY - UNPB
TI - Learning-Enabled Estimation: Tight Characterizations under Sample Selection Biases
AU - Vikram Kher
AU - Jane H. Lee
AU - Anay Mehrotra
AU - Manolis Zampetakis
PY - 2026
DA - 2026/09/29
PB - arXiv
DO - 10.48550/arxiv.2609.38608
UR - https://arxiv.org/abs/2609.38608
AB - When can we learn from biased samples? We study regression when outcomes are observed only after passing through selection filters that depend on both covariates and outcomes themselves, a ubiquitous challenge spanning clinical trials with patient dropout, labor markets with self-selection, and auctions with strategic entry. Ignoring such selection yields systematically biased conclusions with real-world consequences. This challenge has a long history in econometrics and statistics, starting with Heckman's seminal two-stage model and followed by numerous generalizations. While these works provide various sufficient conditions for identification, a complete characterization of when such regression is possible has remained elusive. In this work, we provide a characterization for when regression is possible in the presence of sample selection bias. Our results establish the minimal assumptions required on the functional forms of selection processes under which regression remains possible, which are particularly relevant in modern settings where selection mechanisms are increasingly complex and opaque. As a corollary of our characterization, we show that there are settings where the regression function can be identified even when the selection filter itself cannot. This observation already goes beyond the ``estimate selection filter, then debias regression'' paradigm that is followed by virtually all existing approaches. Under natural strengthenings of our identification conditions, we also establish finite-sample estimation guarantees with explicit convergence rates and provide oracle-efficient algorithms. This yields the first general-purpose estimation method for this broad class of selection problems. Finally, we explore the implications of our results for several well-studied econometric settings with complex selection mechanisms such as auctions with entry costs and labor markets.
ER -