Conditional independence testing through marginal permutation
Abstract
Marginal permutation is exact for testing marginal independence but generally invalid for conditional independence because it breaks the dependence between the exposure (X) and covariates (Z). In this paper, we show that empirical studentization can nevertheless make this deliberately misspecified resampling scheme asymptotically valid for important conditional independence tests based on scores. The resulting procedures are novel in the sense that they are valid in finite samples when the exposure is marginally independent of the outcome (Y) and covariates, and asymptotically valid under the broader conditional independence null, Xindep Y| Z, subject to method-specific conditions. For generalized linear model scores, separately studentizing the observed and permuted scores yields validity under a correctly specified null mean despite \emph{arbitrary} conditional variance misspecification. Moreover, the permutation calibration also applies to tests based on generalized and projected covariance measures. Their validity accommodates machine learning nuisance estimates under a condition on the stability of refitting after permutation, for which we provide sufficient conditions for common regression learners. Permutation calibration preserves first-order local power while better capturing the finite-sample discreteness and skewness induced by sparse observations. Simulations and single-cell CRISPR screen analysis show substantial calibration gains with our methods when effective sample size is small.
Related
- Global Testing of Gaussian Means by Combining Marginal and Conditional Evidence
- Sequential Conditional Independence Testing with Machine Learning Models
- Graph-Based Testing of Conditional Mean Independence with Applications to Large Language Model Evaluation
- Embedding-Bias in Conditional Independence Testing
- Conditional Independence Testing in Time Series
BibTeX
@misc{ai2026conditional,
title = {{Conditional independence testing through marginal permutation}},
author = {Jiahao Ai and Ziang Niu},
howpublished = {arXiv},
year = {2026},
month = nov,
doi = {10.48550/arxiv.2611.03255},
eprint = {2611.03255},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2611.03255},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Conditional independence testing through marginal permutation
AU - Jiahao Ai
AU - Ziang Niu
PY - 2026
DA - 2026/11/02
PB - arXiv
DO - 10.48550/arxiv.2611.03255
UR - https://arxiv.org/abs/2611.03255
AB - Marginal permutation is exact for testing marginal independence but generally invalid for conditional independence because it breaks the dependence between the exposure (X) and covariates (Z). In this paper, we show that empirical studentization can nevertheless make this deliberately misspecified resampling scheme asymptotically valid for important conditional independence tests based on scores. The resulting procedures are novel in the sense that they are valid in finite samples when the exposure is marginally independent of the outcome (Y) and covariates, and asymptotically valid under the broader conditional independence null, Xindep Y| Z, subject to method-specific conditions. For generalized linear model scores, separately studentizing the observed and permuted scores yields validity under a correctly specified null mean despite \emph{arbitrary} conditional variance misspecification. Moreover, the permutation calibration also applies to tests based on generalized and projected covariance measures. Their validity accommodates machine learning nuisance estimates under a condition on the stability of refitting after permutation, for which we provide sufficient conditions for common regression learners. Permutation calibration preserves first-order local power while better capturing the finite-sample discreteness and skewness induced by sparse observations. Simulations and single-cell CRISPR screen analysis show substantial calibration gains with our methods when effective sample size is small.
ER -