The Randomized BH Procedure: A Generalized Framework Encompassing Conformal and Competition Tests
Abstract
We propose the Randomized BH procedure, a generalized framework that introduces randomization into the Benjamini-Hochberg (BH) procedure for false discovery rate (FDR) control. We show that the classical BH procedure as well as two recently developed families of null-distribution-free methods, competition tests and conformal tests, share a common theoretical foundation and arise as special cases of this framework. The Randomized BH relaxes the classical conditions required for FDR control, frees conformal tests from the strict exchangeability assumption while allowing calibration sets to be constructed via pre-screening, and enables competition tests to be analyzed through the well-developed theory of p-values. We illustrate the framework through two applications. The first is a deeper analysis of compound p-values through the lens of randomization. The second is a general approach for integrating distributed multiple testing problems while maintaining global FDR control. Numerical simulations confirm the validity of our theoretical results.
Related
- A Constructive Framework for Generalized Fourier Transforms via Truncate-and-Generalized Limits
- A Framework for Constructing, Estimating, and Validating the Bivariate Generalized Log-Gamma Distribution
- Generalized Functional ANOVA: A Complete Theoretical Framework
- Generalized Odds for Ordinal Outcomes: A Causal Inference Framework Adjusting for Covariates
- Decoupling Evidence Sources in Paraconsistent Logic: A Generalized PAL2v Framework for Educational Assessment
BibTeX
@misc{deng2026randomized,
title = {{The Randomized BH Procedure: A Generalized Framework Encompassing Conformal and Competition Tests}},
author = {Mingzhou Deng and Yan Fu},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2607.07245},
eprint = {2607.07245},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2607.07245},
}
RIS
TY - UNPB
TI - The Randomized BH Procedure: A Generalized Framework Encompassing Conformal and Competition Tests
AU - Mingzhou Deng
AU - Yan Fu
PY - 2026
DA - 2026/10/26
PB - arXiv
DO - 10.48550/arxiv.2607.07245
UR - https://arxiv.org/abs/2607.07245
AB - We propose the Randomized BH procedure, a generalized framework that introduces randomization into the Benjamini-Hochberg (BH) procedure for false discovery rate (FDR) control. We show that the classical BH procedure as well as two recently developed families of null-distribution-free methods, competition tests and conformal tests, share a common theoretical foundation and arise as special cases of this framework. The Randomized BH relaxes the classical conditions required for FDR control, frees conformal tests from the strict exchangeability assumption while allowing calibration sets to be constructed via pre-screening, and enables competition tests to be analyzed through the well-developed theory of p-values. We illustrate the framework through two applications. The first is a deeper analysis of compound p-values through the lens of randomization. The second is a general approach for integrating distributed multiple testing problems while maintaining global FDR control. Numerical simulations confirm the validity of our theoretical results.
ER -