Goodness-of-Fit Tests via Kernel Density Estimation: Univariate and Multivariate Approaches
Abstract
This paper introduces goodness-of-fit tests based on leave-one-out kernel density estimation (KDE) for both univariate and multivariate data. The proposed test statistic takes the form of a log-likelihood ratio comparing a parametric null model with a nonparametric KDE-based estimator, where the leave-one-out construction removes the in-sample bias inherent in standard kernel density estimators. For univariate densities with bounded support, boundary bias is mitigated via reflection techniques. We establish consistency of the proposed tests and show that, under fixed alternatives, the normalized log-statistic converges to the Kullback--Leibler divergence between the true density and the closest parametric model under the null, providing an information-theoretic interpretation of the procedure. A parametric bootstrap is used for finite-sample calibration. Extensive simulation studies and real data applications demonstrate strong empirical performance across a range of univariate and multivariate settings, including heavy-tailed, skewed, and multimodal alternatives.
Related
- Integrated workflow for univariate and multivariate evaluation of batch correction reliability
- Optimal estimation and goodness-of-fit testing of the mean for sparse longitudinal functional data
- Bivariate Frank Copula: Some More Results on Point Estimation of the Association Parameter from a Bayesian Perspective and Revisiting the Goodness of Fit Tests with an Application to Model Groundwater Data from Dong Thap, Vietnam
- Improved estimation of differential entropy of a multivariate Gaussian distribution
- A Mathai-type Multivariate Nakagami-m Distribution: Density, Closed-form Estimators, and Asymptotic Efficiency
BibTeX
@misc{allabadi2026goodnessoffit,
title = {{Goodness-of-Fit Tests via Kernel Density Estimation: Univariate and Multivariate Approaches}},
author = {Luai Al-Labadi and Ayman Alzaatreh and Ruodie Yu and Kairui Bao},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.22541},
eprint = {2610.22541},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.22541},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Goodness-of-Fit Tests via Kernel Density Estimation: Univariate and Multivariate Approaches
AU - Luai Al-Labadi
AU - Ayman Alzaatreh
AU - Ruodie Yu
AU - Kairui Bao
PY - 2026
DA - 2026/10/15
PB - arXiv
DO - 10.48550/arxiv.2610.22541
UR - https://arxiv.org/abs/2610.22541
AB - This paper introduces goodness-of-fit tests based on leave-one-out kernel density estimation (KDE) for both univariate and multivariate data. The proposed test statistic takes the form of a log-likelihood ratio comparing a parametric null model with a nonparametric KDE-based estimator, where the leave-one-out construction removes the in-sample bias inherent in standard kernel density estimators. For univariate densities with bounded support, boundary bias is mitigated via reflection techniques. We establish consistency of the proposed tests and show that, under fixed alternatives, the normalized log-statistic converges to the Kullback--Leibler divergence between the true density and the closest parametric model under the null, providing an information-theoretic interpretation of the procedure. A parametric bootstrap is used for finite-sample calibration. Extensive simulation studies and real data applications demonstrate strong empirical performance across a range of univariate and multivariate settings, including heavy-tailed, skewed, and multimodal alternatives.
ER -