Multi-source conformal prediction: leveraging heterogeneity via localization
Abstract
Many modern prediction tasks involve data from multiple heterogeneous sources, while the test distribution may differ substantially from any individual source. Although heterogeneity poses challenges, it also offers an opportunity: different sources may provide complementary information, with some regions of the feature space better represented in one source than another. We propose Multi-Source Randomly Localized Conformal Prediction (MS-RLCP), which builds on the local coverage properties of randomly localized conformal prediction (RLCP) (Hore and Barber, 2025) and extends it to multiple sources through data-adaptive source selection. Under the widely adopted assumption of a shared response distribution conditional on the features across sources and the test population, we establish finite-sample coverage bounds using an interpretable notion of envelope distribution that captures their aggregate feature-space representation. Our analysis allows the test feature distribution to be absolutely continuous with respect to the envelope, extending beyond mixtures of source distributions. Under additional regularity conditions, we also establish asymptotic test-conditional coverage. Simulations and real-world experiments demonstrate the effectiveness of MS-RLCP across varying levels of data heterogeneity.
Related
- CHOIR: heterogeneity-aware conformal prediction for crash injury severity across driver safety strata
- Conformal Novelty Detection via Data-enhanced Localization
- Leveraging hologenomic data for phenotypic prediction: potential and pitfalls
- Detecting Unseen Jailbreak Sources: A Multi-Source Conformal Detection Perspective
- Optimal Watermark Localization in Mixed-Source Large Language Model Texts
BibTeX
@misc{hore2026multisource,
title = {{Multi-source conformal prediction: leveraging heterogeneity via localization}},
author = {Rohan Hore and Anirban Chatterjee and Sayantan Choudhury},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.14531},
eprint = {2609.14531},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.14531},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Multi-source conformal prediction: leveraging heterogeneity via localization
AU - Rohan Hore
AU - Anirban Chatterjee
AU - Sayantan Choudhury
PY - 2026
DA - 2026/09/13
PB - arXiv
DO - 10.48550/arxiv.2609.14531
UR - https://arxiv.org/abs/2609.14531
AB - Many modern prediction tasks involve data from multiple heterogeneous sources, while the test distribution may differ substantially from any individual source. Although heterogeneity poses challenges, it also offers an opportunity: different sources may provide complementary information, with some regions of the feature space better represented in one source than another. We propose Multi-Source Randomly Localized Conformal Prediction (MS-RLCP), which builds on the local coverage properties of randomly localized conformal prediction (RLCP) (Hore and Barber, 2025) and extends it to multiple sources through data-adaptive source selection. Under the widely adopted assumption of a shared response distribution conditional on the features across sources and the test population, we establish finite-sample coverage bounds using an interpretable notion of envelope distribution that captures their aggregate feature-space representation. Our analysis allows the test feature distribution to be absolutely continuous with respect to the envelope, extending beyond mixtures of source distributions. Under additional regularity conditions, we also establish asymptotic test-conditional coverage. Simulations and real-world experiments demonstrate the effectiveness of MS-RLCP across varying levels of data heterogeneity.
ER -