False Discovery Rate Control via Prediction-Based, Model-Agnostic Data Splitting: An Application to Gut Microbiome Data in Liver Function
Abstract
Many methods have been proposed to control the false discovery rate (FDR) in feature selection, yet challenges remain when the relationship between predictors and the outcome is complex. We propose a prediction-based data-splitting procedure that can leverage flexible predictive models while controlling the FDR. The data are divided into three parts: one for model training and two for constructing the mirror statistic. For each feature, we construct a negative control using the remaining features without incorporating outcome information and define a test statistic based on the resulting change in predictive performance. Under the null, such a perturbation is approximately equally likely to increase or decrease predictive performance, yielding a statistic symmetric about zero. In contrast, perturbing an informative feature tends to reduce predictive performance, resulting in a large positive statistic. Features are selected by thresholding these statistics, with false discoveries estimated from the corresponding negative tail to control the FDR. We apply the proposed method to liver function microbiome data, where high-dimensional, correlated features and potentially complex feature--outcome relationships make reliable type I error control particularly important for reproducible scientific discovery. Through simulation studies and the real-data application, we demonstrate that the proposed framework provides robust FDR control and can be integrated with state-of-the-art machine-learning models to accommodate complex relationships between features and the outcome.
Related
- Controlling the False Discovery Rate via Model-Agnostic Importance Measures
- Geometry-Agnostic Data-Driven Discovery of Extreme Scenarios
- A new operator splitting method for coupled PDE problems, with an application to poromechanics
- Operator splitting methods for non-autonomous evolution equations comprising three parts, with application to the Bloch-Torrey equation of MRI
- Accelerated Convergence of a Second-Order Dynamical System and its Application to Splitting Algorithms for Comonotone Inclusions
BibTeX
@misc{delporte2026false,
title = {{False Discovery Rate Control via Prediction-Based, Model-Agnostic Data Splitting: An Application to Gut Microbiome Data in Liver Function}},
author = {Margaux Delporte and Yushu Shi},
howpublished = {arXiv},
year = {2026},
month = nov,
doi = {10.48550/arxiv.2611.08726},
eprint = {2611.08726},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2611.08726},
note = {CC BY-NC-ND 4.0},
}
RIS
TY - UNPB
TI - False Discovery Rate Control via Prediction-Based, Model-Agnostic Data Splitting: An Application to Gut Microbiome Data in Liver Function
AU - Margaux Delporte
AU - Yushu Shi
PY - 2026
DA - 2026/11/05
PB - arXiv
DO - 10.48550/arxiv.2611.08726
UR - https://arxiv.org/abs/2611.08726
AB - Many methods have been proposed to control the false discovery rate (FDR) in feature selection, yet challenges remain when the relationship between predictors and the outcome is complex. We propose a prediction-based data-splitting procedure that can leverage flexible predictive models while controlling the FDR. The data are divided into three parts: one for model training and two for constructing the mirror statistic. For each feature, we construct a negative control using the remaining features without incorporating outcome information and define a test statistic based on the resulting change in predictive performance. Under the null, such a perturbation is approximately equally likely to increase or decrease predictive performance, yielding a statistic symmetric about zero. In contrast, perturbing an informative feature tends to reduce predictive performance, resulting in a large positive statistic. Features are selected by thresholding these statistics, with false discoveries estimated from the corresponding negative tail to control the FDR. We apply the proposed method to liver function microbiome data, where high-dimensional, correlated features and potentially complex feature--outcome relationships make reliable type I error control particularly important for reproducible scientific discovery. Through simulation studies and the real-data application, we demonstrate that the proposed framework provides robust FDR control and can be integrated with state-of-the-art machine-learning models to accommodate complex relationships between features and the outcome.
ER -