Sketched Calibration for Conformal Prediction under Covariate Shift
Abstract
Weighted conformal prediction corrects for covariate shift by reweighting calibration scores with the likelihood ratio between target and source covariates. Its cost grows with the chi-square divergence between the two covariate laws, typically exponentially in the size of the shift, and much of it can be paid for shift in directions that do not affect the response. We propose sketched calibration: weighted conformal prediction with the ratio of compressed covariates Z=T(X), used in the weights and optionally in the score. Compression never increases the shift-dependent calibration cost, and target coverage is at least 1−α−ΔT, where the leakage ΔT measures how much of the discarded shift reappears as a change in the law of the response, or of the score, given Z. The leakage is a covariance between the discarded shift and the response on the fibres of the sketch; it vanishes when the sketch is sufficient or retains the shift, and a minimax construction shows that no threshold rule for a fixed score can avoid it. In a heteroscedastic simulation where unweighted calibration fails, a one-dimensional sketch cuts the fraction of infinite prediction sets from 37.8% to 8.0% at mean coverage 92.3% for a 90% target; nonlinear and real-data experiments show when learned sketches succeed and when they fail.
Related
- Backward Conformal Prediction under Covariate Shift
- Finite-Sample Optimal Conformal Prediction Sets under Covariate Shift
- Sharp training-conditional coverage for conformal prediction under covariate shift
- Abstention Spends Its Budget on Local Label Variance More Than on Novelty: Auditing Conformal Calibration and Selective Prediction under Molecular Scaffold Shift
- Conformalized Quantile Regression and Minimax Limits of Fixed-Score Calibration under Known Covariate Shift
BibTeX
@misc{pournaderi2026sketched,
title = {{Sketched Calibration for Conformal Prediction under Covariate Shift}},
author = {Mehrdad Pournaderi},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.09208},
eprint = {2610.09208},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.09208},
}
RIS
TY - UNPB
TI - Sketched Calibration for Conformal Prediction under Covariate Shift
AU - Mehrdad Pournaderi
PY - 2026
DA - 2026/10/06
PB - arXiv
DO - 10.48550/arxiv.2610.09208
UR - https://arxiv.org/abs/2610.09208
AB - Weighted conformal prediction corrects for covariate shift by reweighting calibration scores with the likelihood ratio between target and source covariates. Its cost grows with the chi-square divergence between the two covariate laws, typically exponentially in the size of the shift, and much of it can be paid for shift in directions that do not affect the response. We propose sketched calibration: weighted conformal prediction with the ratio of compressed covariates Z=T(X), used in the weights and optionally in the score. Compression never increases the shift-dependent calibration cost, and target coverage is at least 1−α−Δ_T, where the leakage Δ_T measures how much of the discarded shift reappears as a change in the law of the response, or of the score, given Z. The leakage is a covariance between the discarded shift and the response on the fibres of the sketch; it vanishes when the sketch is sufficient or retains the shift, and a minimax construction shows that no threshold rule for a fixed score can avoid it. In a heteroscedastic simulation where unweighted calibration fails, a one-dimensional sketch cuts the fraction of infinite prediction sets from 37.8% to 8.0% at mean coverage 92.3% for a 90% target; nonlinear and real-data experiments show when learned sketches succeed and when they fail.
ER -