Robust Alpha Spending for Unstable Data.
- 1Department of Population Medicine, Harvard Pilgrim Health Care Institute, Boston, Massachusetts, USA.
- 2Computer Department, Federal University of Ouro Preto, Ouro Preto, Brazil.
- 3Department of Population Medicine, Harvard Medical School, Boston, Massachusetts, USA.
Abstract
Sequential hypothesis testing has been used in randomized clinical trials and in monitoring adverse events after vaccination. Typically, the presumption is that all data that have been previously used in the sequential analysis remain the same, and only new data are added. We call this the "anchoring" assumption. In prelicensing randomized trials, enrollment goals are set based on these sequential hypothesis tests so that a trial may stop if a drug proves either too hazardous or, conversely, so beneficial that it would be unethical to deny the treatment to others. However, in monitoring adverse events after vaccination, data are mostly "secondary use," or real-world data. That is, these data are not gathered for research, but are clinical data that have been repurposed for observational vaccine safety surveillance. As such, the counts of exposed persons and adverse events may be subject to revisions over time. These data changes directly challenge the anchoring assumption upon which most sequential hypothesis testing depends. If these data changes are discovered prior to subsequent hypothesis tests, it is unclear how to account for these changes in subsequent tests. We introduce a solution: "robust alpha spending" to protect overall type I error probability, statistical power, and surveillance time from low-level data instability present in secondary use data sources used for adverse event monitoring.
Related
- Rapid drone-based wildfire detection at a fraction of current prevention spending
- Spending Scarce Confirmatory PET Measurements: Target-Aligned Validation in A4/LEARN
- Rigidity from the strong unstable foliation for higher-dimensional Anosov and partially hyperbolic flows
- On the density of Lyapunov unstable elliptic equilibria
- An exact unstable mode of self-similar Yang--Mills solutionsin 5+1 dimensions
BibTeX
@article{silva2026robust,
title = {{Robust Alpha Spending for Unstable Data.}},
author = {Ivair R Silva and Judith C Maro},
journal = {Statistics in medicine},
year = {2026},
month = oct,
doi = {10.1002/sim.70760},
url = {https://europepmc.org/article/MED/42853134},
note = {CC BY},
}
RIS
TY - JOUR
TI - Robust Alpha Spending for Unstable Data.
AU - Ivair R Silva
AU - Judith C Maro
PY - 2026
DA - 2026/10/01
JO - Statistics in medicine
DO - 10.1002/sim.70760
UR - https://europepmc.org/article/MED/42853134
AB - Sequential hypothesis testing has been used in randomized clinical trials and in monitoring adverse events after vaccination. Typically, the presumption is that all data that have been previously used in the sequential analysis remain the same, and only new data are added. We call this the "anchoring" assumption. In prelicensing randomized trials, enrollment goals are set based on these sequential hypothesis tests so that a trial may stop if a drug proves either too hazardous or, conversely, so beneficial that it would be unethical to deny the treatment to others. However, in monitoring adverse events after vaccination, data are mostly "secondary use," or real-world data. That is, these data are not gathered for research, but are clinical data that have been repurposed for observational vaccine safety surveillance. As such, the counts of exposed persons and adverse events may be subject to revisions over time. These data changes directly challenge the anchoring assumption upon which most sequential hypothesis testing depends. If these data changes are discovered prior to subsequent hypothesis tests, it is unclear how to account for these changes in subsequent tests. We introduce a solution: "robust alpha spending" to protect overall type I error probability, statistical power, and surveillance time from low-level data instability present in secondary use data sources used for adverse event monitoring.
SN - 0277-6715
SN - 1097-0258
ER -