Copula Active Subspaces II: Error Decomposition, A Posteriori Estimation, and Sharpness of the Bounds
Abstract
The Copula Active Subspaces (CAS) method of Part I estimates a non-Gaussian observation-noise density πn from residual samples. Its KL divergence 𝒟KL(πn | π̂n) admits an exact decomposition into marginal, projection and reduced-density terms and bounds the posterior KL divergence averaged over the true predictive distribution. We derive a priori bounds for these terms, together with estimates or bounds from residual samples. Weighted nearest-neighbour entropy estimates are used for the marginal and reduced-density terms, with asymptotic standard errors in exact rank coordinates. For the projection error, the score is fitted on one subsample, and its mean squared magnitude outside the retained subspace is estimated on the other. Corrections for score and rank-transform errors then give a theoretical upper bound with probability at least 1−δ. Tests on three known noise laws in dimension d=20 use the estimated rank transform. In $11$ of $12$ combinations of example and sample size, the sum of the two estimated terms and the trace bound exceeds the reference divergence after averaging over the estimated models. In these tests, score-estimation error is the largest contribution to looseness. The overestimate from the Gaussian log-Sobolev inequality alone is at most a factor of $1.98$.
Related
- Copula Active Subspaces I: A Score-Covariance Method for Reduced-Order Non-Gaussian Density Estimation
- A copula-based competing risks model with application to cancer risk estimation in family studies
- Bivariate Frank Copula: Some More Results on Point Estimation of the Association Parameter from a Bayesian Perspective and Revisiting the Goodness of Fit Tests with an Application to Model Groundwater Data from Dong Thap, Vietnam
- A posteriori error estimation for coarse or distorted meshes
- Sharp convergence rate of the estimation error of LASSO via the Feature Space Decomposition method
BibTeX
@misc{chen2026copula,
title = {{Copula Active Subspaces II: Error Decomposition, A Posteriori Estimation, and Sharpness of the Bounds}},
author = {Joshua Chen and Peter Jan van Leeuwen},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.14498},
eprint = {2610.14498},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.14498},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Copula Active Subspaces II: Error Decomposition, A Posteriori Estimation, and Sharpness of the Bounds
AU - Joshua Chen
AU - Peter Jan van Leeuwen
PY - 2026
DA - 2026/10/10
PB - arXiv
DO - 10.48550/arxiv.2610.14498
UR - https://arxiv.org/abs/2610.14498
AB - The Copula Active Subspaces (CAS) method of Part I estimates a non-Gaussian observation-noise density π_n from residual samples. Its KL divergence 𝒟_KL(π_n | π̂_n) admits an exact decomposition into marginal, projection and reduced-density terms and bounds the posterior KL divergence averaged over the true predictive distribution. We derive a priori bounds for these terms, together with estimates or bounds from residual samples. Weighted nearest-neighbour entropy estimates are used for the marginal and reduced-density terms, with asymptotic standard errors in exact rank coordinates. For the projection error, the score is fitted on one subsample, and its mean squared magnitude outside the retained subspace is estimated on the other. Corrections for score and rank-transform errors then give a theoretical upper bound with probability at least 1−δ. Tests on three known noise laws in dimension d=20 use the estimated rank transform. In $11$ of $12$ combinations of example and sample size, the sum of the two estimated terms and the trace bound exceeds the reference divergence after averaging over the estimated models. In these tests, score-estimation error is the largest contribution to looseness. The overestimate from the Gaussian log-Sobolev inequality alone is at most a factor of $1.98$.
ER -