Reusing Statistical Guarantees Under Change: Selection Costs and Event Ownership
Abstract
An adaptive system can retain an earlier estimate while changing what that estimate is used to guarantee. The guarantee depends on the experiment that produced the evidence, including how its target was selected and which assumptions connect it to the current claim. We show that past-measurable selection preserves future martingale dynamics without preserving a unit expected starting value. An exact finite counterexample, using a strictly positive family, refutes a published changing-prior extension as stated with probability one and rules out unrestricted bounds based only on switch count and the error level. We give a paid-start multi-switch correction and establish m as the sharp worst-case expected starting-moment cost for an unstructured family of m hypotheses. We then develop Adaptive Assurance, a framework in which statistical events retain their experiment, funding and outcome bindings while claims and premise dependencies change. Compatible-outcome projection supports reuse, selective invalidation, fresh acquisition and auditable decisions. Two histories can have identical current regions yet require different responses to a later edit, making evidence origin part of the assurance state. Studies in six public-recorded domains exercise heterogeneous outcomes and access contracts. Component interventions expose erroneous inheritance and unnecessary resets. The framework separates conditional guarantee recovery from competence adaptation, with explicit costs for evidence, computation and verification.
Related
- Valid Data‐Driven Subgroup Selection With Uniform Guarantees in Clinical Trials
- Statistical Guarantees for Covariance Estimation with Adversarial Corruption under Constraints
- Statistical and Privacy Guarantees for Deep M-Regression via Stochastic Gradient Langevin Dynamics
- Computational and Statistical Guarantees of the c-Rectified flow
- Statistically Valid Post-Training Hyperparameter Selection: From Tuning to Guarantees
BibTeX
@misc{li2026reusing,
title = {{Reusing Statistical Guarantees Under Change: Selection Costs and Event Ownership}},
author = {Ao Li and Weitong Chen},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.09391},
eprint = {2610.09391},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.09391},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Reusing Statistical Guarantees Under Change: Selection Costs and Event Ownership
AU - Ao Li
AU - Weitong Chen
PY - 2026
DA - 2026/10/07
PB - arXiv
DO - 10.48550/arxiv.2610.09391
UR - https://arxiv.org/abs/2610.09391
AB - An adaptive system can retain an earlier estimate while changing what that estimate is used to guarantee. The guarantee depends on the experiment that produced the evidence, including how its target was selected and which assumptions connect it to the current claim. We show that past-measurable selection preserves future martingale dynamics without preserving a unit expected starting value. An exact finite counterexample, using a strictly positive family, refutes a published changing-prior extension as stated with probability one and rules out unrestricted bounds based only on switch count and the error level. We give a paid-start multi-switch correction and establish m as the sharp worst-case expected starting-moment cost for an unstructured family of m hypotheses. We then develop Adaptive Assurance, a framework in which statistical events retain their experiment, funding and outcome bindings while claims and premise dependencies change. Compatible-outcome projection supports reuse, selective invalidation, fresh acquisition and auditable decisions. Two histories can have identical current regions yet require different responses to a later edit, making evidence origin part of the assurance state. Studies in six public-recorded domains exercise heterogeneous outcomes and access contracts. Component interventions expose erroneous inheritance and unnecessary resets. The framework separates conditional guarantee recovery from competence adaptation, with explicit costs for evidence, computation and verification.
ER -