A new categorical correlation measure

Abstract

Feature screening in high-dimensional classification is an important problem in statistical learning, particularly in genomics, imaging, and other scientific fields, especially when the number of predictors exceeds the sample size. Zhong et al. (2024) present a semi-distance covariance (SDCov) as a dependence measure between a categorical random variable and a multivariate continuous random vector, presenting it as a promising tool for group-wise feature screening. However, SDCov is defined using the Euclidean norm, and its performance may be affected when the data is derived from heavy-tailed distributions or when outlier observations are present, which is a common phenomenon in high-dimensional data. This study proposes a modification of SDCov by replacing the L₂ norm with an L₁ norm. This adjustment results in a dependency measure between a categorical variable and a multivariate continuous variable that maintains the independence-characterization property of the original definition. Additionally, it serves as a robust and interpretable measure, particularly in the presence of outliers in the data. We establish the fundamental theoretical properties of the proposed measure and introduce a U-statistics-based estimator along with JEL-based inference for the measure. Additionally, we have introduced a test for independence based on the proposed measure. An extensive Monte Carlo simulation is performed to evaluate the effectiveness of the proposed measure in comparison to existing measures in the literature. The proposed measure is applied in feature screening, as illustrated with the ADNI Alzheimer's disease dataset and the Iris dataset. The data analysis shows the proposed measure's effectiveness in identifying variables that facilitate strong class separation of the respective response variables.

A Categorical Realization of the (2-)Category of Monoids via Sch{ü}tzenberger Categories and Strict Factorization Systems
Xavier Mary
Compositionality11 Sep 2026Peer-reviewedLicence not statedGeneral mathematicsHAL
A Categorical Framework for the Negami Polynomial and Its Splitting Formula
Iwao Mizukai
arXiv30 Aug 2026PreprintarXiv licenceFull textCombinatorics & discrete mathematicsarXiv
A Polytopal Realization of Higher-Categorical Associahedra
Spencer Backman, Nathaniel Bottman, Daria Poliakova
arXiv21 Sep 2026PreprintarXiv licenceFull textAlgebra & number theory Combinatorics & discrete mathematicsarXiv
Unipotent representations and the categorical trace of Frobenius
Wyatt Reeves
arXiv22 Oct 2026PreprintarXiv licenceFull textAlgebra & number theoryarXiv
Duality theory for categorical theories
Lingyuan Ye
arXiv24 Oct 2026PreprintCC BY-SA 4.0Full textAlgebra & number theory Logic & foundationsarXiv

Cite

BibTeX RIS

BibTeX

@misc{suresh2026categorical,
  title = {{A new categorical correlation measure}},
  author = {Saparya Suresh and Sudheesh K. Kattumannil and Sujit Ghosh},
  howpublished = {arXiv},
  year = {2026},
  month = oct,
  doi = {10.48550/arxiv.2610.34932},
  eprint = {2610.34932},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.34932},
  note = {CC BY 4.0},
}

RIS

TY  - UNPB
TI  - A new categorical correlation measure
AU  - Saparya Suresh
AU  - Sudheesh K. Kattumannil
AU  - Sujit Ghosh
PY  - 2026
DA  - 2026/10/26
PB  - arXiv
DO  - 10.48550/arxiv.2610.34932
UR  - https://arxiv.org/abs/2610.34932
AB  - Feature screening in high-dimensional classification is an important problem in statistical learning, particularly in genomics, imaging, and other scientific fields, especially when the number of predictors exceeds the sample size. Zhong et al. (2024) present a semi-distance covariance (SDCov) as a dependence measure between a categorical random variable and a multivariate continuous random vector, presenting it as a promising tool for group-wise feature screening. However, SDCov is defined using the Euclidean norm, and its performance may be affected when the data is derived from heavy-tailed distributions or when outlier observations are present, which is a common phenomenon in high-dimensional data. This study proposes a modification of SDCov by replacing the L_2 norm with an L_1 norm. This adjustment results in a dependency measure between a categorical variable and a multivariate continuous variable that maintains the independence-characterization property of the original definition. Additionally, it serves as a robust and interpretable measure, particularly in the presence of outliers in the data. We establish the fundamental theoretical properties of the proposed measure and introduce a U-statistics-based estimator along with JEL-based inference for the measure. Additionally, we have introduced a test for independence based on the proposed measure. An extensive Monte Carlo simulation is performed to evaluate the effectiveness of the proposed measure in comparison to existing measures in the literature. The proposed measure is applied in feature screening, as illustrated with the ADNI Alzheimer's disease dataset and the Iris dataset. The data analysis shows the proposed measure's effectiveness in identifying variables that facilitate strong class separation of the respective response variables.
ER  -

Abstract

Related

Cite