Nonparametric framework for the definition, adaptive detection and probabilistic interpretation of outliers
Abstract
Outlier detection is a fundamental challenge in data processing, with critical implications for robustness across statistical modeling, machine learning and exploratory data analysis. However, existing proposals rarely offer a universal, domain-agnostic definition of an outlier, often relying on heuristic trimming quotas that lack a statistical interpretation. To address this, we propose a nonparametric framework built on a pseudo-isolation outlier score. This score enables a formal, probabilistic definition of an anomaly tied to a false-alarm rate α, which extends into a rigorous geometric classification of internal and external outliers. We show that this mechanism seamlessly embeds into any objective-based clustering framework to identify cluster-specific outliers. Here, we integrate it into K-means to create ODK-means. The inferential capabilities and topological properties of this framework are explored both theoretically through formal propositions and empirically through extensive simulations and methodological tutorials, highlighting the practical actionability and intuitive appeal of the proposed outlier detection logic.
Related
- GT-PSSM: Unified Probabilistic Framework for Stochastic Dynamics Modeling and Dependency Learning in Multivariate Time Series Anomaly Detection
- Nonparametric Change-Point Detection and Inference for High-Dimensional Distributions
- Dirichlet Process Mixtures of Trees with Gaussian Process Splits: A Bayesian Nonparametric Framework with Posterior Contraction Rate
- SNACK: A Sequential Notation Framework for Probabilistic Graph Generation
- Neural Ideals and Neural Codes: An Algebraic Framework for Neural Network Classification and Feature Interpretation
BibTeX
@misc{iannaccio2026nonparametric,
title = {{Nonparametric framework for the definition, adaptive detection and probabilistic interpretation of outliers}},
author = {Tiziano Iannaccio and Maurizio Vichi},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.08494},
eprint = {2609.08494},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.08494},
}
RIS
TY - UNPB
TI - Nonparametric framework for the definition, adaptive detection and probabilistic interpretation of outliers
AU - Tiziano Iannaccio
AU - Maurizio Vichi
PY - 2026
DA - 2026/09/08
PB - arXiv
DO - 10.48550/arxiv.2609.08494
UR - https://arxiv.org/abs/2609.08494
AB - Outlier detection is a fundamental challenge in data processing, with critical implications for robustness across statistical modeling, machine learning and exploratory data analysis. However, existing proposals rarely offer a universal, domain-agnostic definition of an outlier, often relying on heuristic trimming quotas that lack a statistical interpretation. To address this, we propose a nonparametric framework built on a pseudo-isolation outlier score. This score enables a formal, probabilistic definition of an anomaly tied to a false-alarm rate α, which extends into a rigorous geometric classification of internal and external outliers. We show that this mechanism seamlessly embeds into any objective-based clustering framework to identify cluster-specific outliers. Here, we integrate it into K-means to create ODK-means. The inferential capabilities and topological properties of this framework are explored both theoretically through formal propositions and empirically through extensive simulations and methodological tutorials, highlighting the practical actionability and intuitive appeal of the proposed outlier detection logic.
ER -