Moment-Calibrated Conformal Prediction with Side Information
Abstract
For a fixed conformal score function, standard split conformal prediction calibrates a prediction set using the empirical distribution of the conformal scores, without using available side information about the data. We propose a moment-calibrated approach that uses such information to reduce variability across calibration data sets. Side information involving the covariates, the response, or both is expressed as moment restrictions, which are enforced through empirical likelihood weights on the calibration data points. The resulting weighted empirical distribution of the scores determines the weighted empirical quantile without changing the score function. We establish finite-sample bounds on training-conditional and marginal coverage of the moment-calibrated prediction set. We derive asymptotic distributions for training-conditional coverage and average prediction-set size, show that their asymptotic variances are no larger than the corresponding variances under standard split conformal prediction, and characterize when the reductions are strict. In the semi-supervised setting, we identify an optimal moment function of a given covariate representation, develop implementations using prespecified moment functions or a function learned by cross-fitting, and quantify the effect of the unlabeled sample size. We also extend the method to coverage conditions indexed by a class of functions of the covariates through weighted quantile regression. Numerical studies demonstrate the effectiveness of the proposed methods.
Related
- Curvature-Calibrated Quasi-Bayesian Updating for Moment-Restricted Models
- Reference-Null Calibrated Thresholds for E-Processes with Applications to Conformal Martingales
- SCOPE Before You Sample: Conformal Scores Guide Posterior Exploration for Fast and Calibrated Bayesian Predictive Inference
- Calibrated for Which Policy? Conformal Uncertainty for Fixed World Models Under Intervention
- Estimation with Quantized Parameter Side-Information
BibTeX
@misc{wang2026momentcalibrated,
title = {{Moment-Calibrated Conformal Prediction with Side Information}},
author = {Guanghui Wang and Liuhua Peng and Liu Liu and Changliang Zou},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.15268},
eprint = {2610.15268},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.15268},
}
RIS
TY - UNPB
TI - Moment-Calibrated Conformal Prediction with Side Information
AU - Guanghui Wang
AU - Liuhua Peng
AU - Liu Liu
AU - Changliang Zou
PY - 2026
DA - 2026/10/11
PB - arXiv
DO - 10.48550/arxiv.2610.15268
UR - https://arxiv.org/abs/2610.15268
AB - For a fixed conformal score function, standard split conformal prediction calibrates a prediction set using the empirical distribution of the conformal scores, without using available side information about the data. We propose a moment-calibrated approach that uses such information to reduce variability across calibration data sets. Side information involving the covariates, the response, or both is expressed as moment restrictions, which are enforced through empirical likelihood weights on the calibration data points. The resulting weighted empirical distribution of the scores determines the weighted empirical quantile without changing the score function. We establish finite-sample bounds on training-conditional and marginal coverage of the moment-calibrated prediction set. We derive asymptotic distributions for training-conditional coverage and average prediction-set size, show that their asymptotic variances are no larger than the corresponding variances under standard split conformal prediction, and characterize when the reductions are strict. In the semi-supervised setting, we identify an optimal moment function of a given covariate representation, develop implementations using prespecified moment functions or a function learned by cross-fitting, and quantify the effect of the unlabeled sample size. We also extend the method to coverage conditions indexed by a class of functions of the covariates through weighted quantile regression. Numerical studies demonstrate the effectiveness of the proposed methods.
ER -