Benchmarking Statistical Methods for Differential Composition Analysis in Population-Scale Single-Cell Data
- 1Department of Biostatistics and Bioinformatics, Emory University, Atlanta, GA, USA
Abstract
Population-scale single-cell RNA sequencing (scRNA-seq) data capture cellular composition across cohorts ranging from several dozen to thousands of individuals, enabling the detection of cell-type composition differences between conditions. These differences reveal cellular shifts in disease pathogenesis and suggest potential targets for therapeutic intervention. However, differential composition analysis in scRNA-seq data is challenged by the unique features of cell count data, such as compositionality, prevalence of zeros, overdispersion, and confounding by technical and biological covariates. While this analysis is routinely performed, no study has yet systematically evaluated existing methods. Here, we benchmarked 12 methods for differential composition analysis using three population-scale scRNA-seq datasets with diverse and representative characteristics. Analyses of real data revealed low agreement across methods, while permutations and simulations based on the real data demonstrated excessive false discoveries for most methods. Overall, LOCOM emerged as the top-performing method that controls the false discovery rate while maintaining good statistical power, followed by ANCOM-BC and linear regression with centered-log-ratio transformation. Integrating evidence from real-data analyses and data-informed permutation and simulation experiments, we provide practical guidance tailored to common real-world challenges in differential composition analysis.
Related
- Benchmarking normalisation methods for differential binding analysis in CUT&RUN
- 'broadSeq', a benchmarking tool to contrast differential gene expression methods and identify when genomic neighbourhood matters
- OncoSpot enables benchmarking of cancer spatial transcriptomics methods across tumor evolutionary modes
- DiffRhyShiny: A Benchmarking-Informed Platform for Differential Rhythmicity Analysis with Dependence-Aware Evidence Integration
- Benchmarking Microbiome Methods for Improved Metagenomic Sequencing of Lower Respiratory Tract Samples
BibTeX
@misc{wu2026benchmarking,
title = {{Benchmarking Statistical Methods for Differential Composition Analysis in Population-Scale Single-Cell Data}},
author = {W. Wu and M. He and Y. Hu and C. Su},
howpublished = {bioRxiv},
year = {2026},
month = nov,
doi = {10.64898/2026.11.04.764099},
url = {https://www.biorxiv.org/content/10.64898/2026.11.04.764099v1},
note = {CC BY},
}
RIS
TY - UNPB
TI - Benchmarking Statistical Methods for Differential Composition Analysis in Population-Scale Single-Cell Data
AU - W. Wu
AU - M. He
AU - Y. Hu
AU - C. Su
PY - 2026
DA - 2026/11/04
PB - bioRxiv
DO - 10.64898/2026.11.04.764099
UR - https://www.biorxiv.org/content/10.64898/2026.11.04.764099v1
AB - Population-scale single-cell RNA sequencing (scRNA-seq) data capture cellular composition across cohorts ranging from several dozen to thousands of individuals, enabling the detection of cell-type composition differences between conditions. These differences reveal cellular shifts in disease pathogenesis and suggest potential targets for therapeutic intervention. However, differential composition analysis in scRNA-seq data is challenged by the unique features of cell count data, such as compositionality, prevalence of zeros, overdispersion, and confounding by technical and biological covariates. While this analysis is routinely performed, no study has yet systematically evaluated existing methods. Here, we benchmarked 12 methods for differential composition analysis using three population-scale scRNA-seq datasets with diverse and representative characteristics. Analyses of real data revealed low agreement across methods, while permutations and simulations based on the real data demonstrated excessive false discoveries for most methods. Overall, LOCOM emerged as the top-performing method that controls the false discovery rate while maintaining good statistical power, followed by ANCOM-BC and linear regression with centered-log-ratio transformation. Integrating evidence from real-data analyses and data-informed permutation and simulation experiments, we provide practical guidance tailored to common real-world challenges in differential composition analysis.
ER -