Covariate Selection for Doubly Robust Double/debiased Machine Learning Estimators for Causal Inference
Abstract
High-dimensional data create challenges for causal effect estimation because identifying the covariates needed for correct model specification becomes increasingly difficult. Double/debiased machine learning (DML) facilitates the use of machine learning (ML) for causal inference by mitigating regularization and overfitting bias, but comparatively less attention has been given to covariate selection in relation to the double robustness (DR) property possessed by some DML estimators. In particular, ML-based covariate selection may result in differential covariate selection or in misspecification of both models, thereby limiting the practical utility of the DR property. To address these issues, we propose using the union of the covariates selected by the propensity score (PS) and outcome ML models to re-estimate both models. Simulation results show that using the union consistently reduces more confounding bias than using separate selected covariate sets. The results also show that ML-based estimation does not uniformly outperform conventional DR estimation, even under conditions favorable to the Lasso, and that post-Lasso reduces more confounding bias than standard Lasso. These findings demonstrate that successful use of ML for causal inference depends not only on the ML algorithm but also on how the information obtained through covariate selection is incorporated into causal effect estimation.
Related
- HEDE: Heritability estimation in high dimensions by ensembling debiased estimators in genome-wide association studies
- Debiased parametric inference for regime-switching jump diffusions with infinite variation jumps
- Debiased inference for proximal dose-response function
- Debiased and Simultaneous Inference for Heterogeneous Factorial Effect Modifiers via Residualized Walsh-Hadamard Scores
- Debiased Prior-Data Fitted Networks for Amortized Bayesian Semi-Parametric Inference
BibTeX
@misc{kwon2026covariate,
title = {{Covariate Selection for Doubly Robust Double/debiased Machine Learning Estimators for Causal Inference}},
author = {Muwon Kwon and Peter M. Steiner},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.17238},
eprint = {2609.17238},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.17238},
}
RIS
TY - UNPB
TI - Covariate Selection for Doubly Robust Double/debiased Machine Learning Estimators for Causal Inference
AU - Muwon Kwon
AU - Peter M. Steiner
PY - 2026
DA - 2026/09/15
PB - arXiv
DO - 10.48550/arxiv.2609.17238
UR - https://arxiv.org/abs/2609.17238
AB - High-dimensional data create challenges for causal effect estimation because identifying the covariates needed for correct model specification becomes increasingly difficult. Double/debiased machine learning (DML) facilitates the use of machine learning (ML) for causal inference by mitigating regularization and overfitting bias, but comparatively less attention has been given to covariate selection in relation to the double robustness (DR) property possessed by some DML estimators. In particular, ML-based covariate selection may result in differential covariate selection or in misspecification of both models, thereby limiting the practical utility of the DR property. To address these issues, we propose using the union of the covariates selected by the propensity score (PS) and outcome ML models to re-estimate both models. Simulation results show that using the union consistently reduces more confounding bias than using separate selected covariate sets. The results also show that ML-based estimation does not uniformly outperform conventional DR estimation, even under conditions favorable to the Lasso, and that post-Lasso reduces more confounding bias than standard Lasso. These findings demonstrate that successful use of ML for causal inference depends not only on the ML algorithm but also on how the information obtained through covariate selection is incorporated into causal effect estimation.
ER -