From Test Performance to Risk-Based Effect Sizes: A Unified Wald-Type Framework to Design Clinical Validation Studies for Binary and Survival Outcomes
Abstract
Clinical validation studies of predictive tests are usually designed to focus on sensitivity (Se) and specificity (Sp), while statistical power is often calculated on regression-effect scales (e.g., risk ratio, hazard ratio). However, these quantities are statistically connected. Here, we provide closed-form links from sensitivity, specificity, and disease prevalence (π) to predictive risks, risk contrasts, and Wald-type variance, power, and sample-size formulas for binary and fixed-horizon survival outcomes. Analyses of statistical efficiency via C- and D-optimal principles demonstrate how prevalence and threshold choices affect study efficiency, supporting rapid decisions in preliminary studies and informing the design of subsequent, larger studies. Simulations show good calibration across most realistic scenarios; when events are rare and test effects are simultaneously very large, continuity and minimum-event corrections are needed to stabilize the approximation. We illustrate the framework with a case study describing use of the coronary artery calcium score for predicting incident cardiovascular disease in patients with type 2 diabetes mellitus. The formulas let investigators check power and required enrollment directly from $(Se,Sp,π)$, without running a separate simulation for each design candidate.
Related
- Can AI Agents Simulate A/B Test Outcomes? A Validation Framework for Agentic Experimentation
- Evaluation of clinical prediction models: Decomposing performance uncertainty into model development and validation components
- A flexible framework for treatment effect inference in longitudinal clinical studies with skewed outcomes
- Partial Identification of Survival Prediction Performance under Dependent Right Censoring
- Bayesian joint modeling of longitudinal patient-reported outcomes and survival: an application to chronic obstructive pulmonary disease
BibTeX
@misc{zhong2026from,
title = {{From Test Performance to Risk-Based Effect Sizes: A Unified Wald-Type Framework to Design Clinical Validation Studies for Binary and Survival Outcomes}},
author = {Yongqi Zhong and Anne-Renee Hartman and Jing Zhang},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2608.30801},
eprint = {2608.30801},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2608.30801},
}
RIS
TY - UNPB
TI - From Test Performance to Risk-Based Effect Sizes: A Unified Wald-Type Framework to Design Clinical Validation Studies for Binary and Survival Outcomes
AU - Yongqi Zhong
AU - Anne-Renee Hartman
AU - Jing Zhang
PY - 2026
DA - 2026/09/15
PB - arXiv
DO - 10.48550/arxiv.2608.30801
UR - https://arxiv.org/abs/2608.30801
AB - Clinical validation studies of predictive tests are usually designed to focus on sensitivity (Se) and specificity (Sp), while statistical power is often calculated on regression-effect scales (e.g., risk ratio, hazard ratio). However, these quantities are statistically connected. Here, we provide closed-form links from sensitivity, specificity, and disease prevalence (π) to predictive risks, risk contrasts, and Wald-type variance, power, and sample-size formulas for binary and fixed-horizon survival outcomes. Analyses of statistical efficiency via C- and D-optimal principles demonstrate how prevalence and threshold choices affect study efficiency, supporting rapid decisions in preliminary studies and informing the design of subsequent, larger studies. Simulations show good calibration across most realistic scenarios; when events are rare and test effects are simultaneously very large, continuity and minimum-event corrections are needed to stabilize the approximation. We illustrate the framework with a case study describing use of the coronary artery calcium score for predicting incident cardiovascular disease in patients with type 2 diabetes mellitus. The formulas let investigators check power and required enrollment directly from $(Se,Sp,π)$, without running a separate simulation for each design candidate.
ER -