Online Conformal Prediction for Non-Exchangeable Panel Data
Abstract
We study online conformal prediction in a partially observed panel: a new cross-section of peer outcomes is observed before each target outcome, target feedback may be intermittent or absent, and neither units nor rounds need be exchangeable. We propose Weighted Temporal Quantile Adjustment (W-TQA), which combines similarity weights learned from unit histories with an adaptive target-specific miscoverage level. We prove that neither target-peer mismatch nor coverage on unrevealed rounds is identifiable, so assumptions on cross-unit similarity and on the feedback mechanism cannot be avoided. We bound the past-conditional miscoverage in terms of this mismatch, quantify the cost of learning the weights under a profile-similarity assumption, and show that the implemented procedure, which falls back on the largest peer score, attains long-run average coverage under missing-completely-at-random feedback and a feasibility condition on the calibration panel. On synthetic panels and four real panels, including a genuinely asynchronous U.S.-to-Tokyo equity panel, W-TQA attains the highest coverage on the worst-covered target units on every panel; similarity weighting contributes most when target feedback is scarce, and temporal adaptation more as feedback accumulates.
Related
- Practical Advantages of Online Conformal Prediction for Data Streams
- Efficient conformal prediction intervals for time series: Online PID-Expert aggregation
- Conformal Annotation with Randomized Expert Review: Application to Online Cell-Type Labeling
- Online Shift Detection and Conformal Adaptation for Deployed Safety Classifiers
- Generalized Hyperrectangular Prediction Sets in Multivariate Conformal Prediction
BibTeX
@misc{tu2026online,
title = {{Online Conformal Prediction for Non-Exchangeable Panel Data}},
author = {Daohong Tu and Kay Giesecke},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2605.17705},
eprint = {2605.17705},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2605.17705},
}
RIS
TY - UNPB
TI - Online Conformal Prediction for Non-Exchangeable Panel Data
AU - Daohong Tu
AU - Kay Giesecke
PY - 2026
DA - 2026/10/05
PB - arXiv
DO - 10.48550/arxiv.2605.17705
UR - https://arxiv.org/abs/2605.17705
AB - We study online conformal prediction in a partially observed panel: a new cross-section of peer outcomes is observed before each target outcome, target feedback may be intermittent or absent, and neither units nor rounds need be exchangeable. We propose Weighted Temporal Quantile Adjustment (W-TQA), which combines similarity weights learned from unit histories with an adaptive target-specific miscoverage level. We prove that neither target-peer mismatch nor coverage on unrevealed rounds is identifiable, so assumptions on cross-unit similarity and on the feedback mechanism cannot be avoided. We bound the past-conditional miscoverage in terms of this mismatch, quantify the cost of learning the weights under a profile-similarity assumption, and show that the implemented procedure, which falls back on the largest peer score, attains long-run average coverage under missing-completely-at-random feedback and a feasibility condition on the calibration panel. On synthetic panels and four real panels, including a genuinely asynchronous U.S.-to-Tokyo equity panel, W-TQA attains the highest coverage on the worst-covered target units on every panel; similarity weighting contributes most when target feedback is scarce, and temporal adaptation more as feedback accumulates.
ER -