Limitations of differential expression for cell-type marker discovery in single-cell RNA sequencing atlases
- 1National Library of Medicine
Abstract
Cell-type marker genes are definitional characteristics of a cell type, and in single-cell RNA sequencing atlases they are commonly nominated through differential expression (DE) testing. The Wilcoxon rank-sum test is the default method for marker gene discovery in Seurat and a recommended method in Scanpy, two widely used computational software packages for scRNA-seq analysis. Structurally, Wilcoxon's standardized statistic grows with sample size at a fixed underlying effect, meaning computed rankings across clusters of unequal size are incomparable. We quantified this effect across three atlas datasets - lung, kidney, and brain. Mean Wilcoxon score scaled with log cluster size at Pearson correlation r = 0.90-0.95 in each organ. In contrast, a classification-based comparator, NS-Forest, showed low correlation with cluster size (r = 0.10-0.28). This DE-cluster size relationship remained essentially unchanged after controlling for classification performance through partial correlation, decayed monotonically under cluster size downsampling, and was reproduced in simulation with marker quality fixed. The Wilcoxon rank-sum test can be transformed into a rank-based effect size by normalizing by the target-background pair count, removing the positive size dependence. However, this effect size nominates an identical set of candidate genes as the original statistic, indicating the cluster size dependence and poor specificity of DE nominated genes are separate problems. Genes nominated under default settings were substantially less specific to their target clusters, with median on-target fractions of 0.204 (lung), 0.166 (kidney), and 0.083 (brain), compared to NS-Forest's marker genes (0.580, 0.687, 0.364), revealing the relatively poor specificity that highly scoring DE genes exhibit.
Related
- scGSCA: gene-set differential co-expression analysis for single-cell RNA sequencing data
- False discovery rate control enables trustworthy deep-learning-based de novo peptide sequencing
- NicheCorr: Identifying Niche-Specific Differential Gene Co-Expression in Spatial Transcriptomics
- Novel two-stage deep learning-based approach applied to gene expression data pertaining to esophageal adenocarcinoma boosting biological knowledge discovery
- Differential Gene Expression and Functional Enrichment Analysis of Breast Tumor and Normal Tissue RNA-seq Data: A Reanalysis of GEO Dataset GSE210787
BibTeX
@misc{doggett2026limitations,
title = {{Limitations of differential expression for cell-type marker discovery in single-cell RNA sequencing atlases}},
author = {K. Doggett and D. Pintard and R. H. Scheuermann and Y. Zhang},
howpublished = {bioRxiv},
year = {2026},
month = sep,
doi = {10.64898/2026.09.25.754486},
url = {https://www.biorxiv.org/content/10.64898/2026.09.25.754486v1},
note = {CC0},
}
RIS
TY - UNPB
TI - Limitations of differential expression for cell-type marker discovery in single-cell RNA sequencing atlases
AU - K. Doggett
AU - D. Pintard
AU - R. H. Scheuermann
AU - Y. Zhang
PY - 2026
DA - 2026/09/25
PB - bioRxiv
DO - 10.64898/2026.09.25.754486
UR - https://www.biorxiv.org/content/10.64898/2026.09.25.754486v1
AB - Cell-type marker genes are definitional characteristics of a cell type, and in single-cell RNA sequencing atlases they are commonly nominated through differential expression (DE) testing. The Wilcoxon rank-sum test is the default method for marker gene discovery in Seurat and a recommended method in Scanpy, two widely used computational software packages for scRNA-seq analysis. Structurally, Wilcoxon's standardized statistic grows with sample size at a fixed underlying effect, meaning computed rankings across clusters of unequal size are incomparable. We quantified this effect across three atlas datasets - lung, kidney, and brain. Mean Wilcoxon score scaled with log cluster size at Pearson correlation r = 0.90-0.95 in each organ. In contrast, a classification-based comparator, NS-Forest, showed low correlation with cluster size (r = 0.10-0.28). This DE-cluster size relationship remained essentially unchanged after controlling for classification performance through partial correlation, decayed monotonically under cluster size downsampling, and was reproduced in simulation with marker quality fixed. The Wilcoxon rank-sum test can be transformed into a rank-based effect size by normalizing by the target-background pair count, removing the positive size dependence. However, this effect size nominates an identical set of candidate genes as the original statistic, indicating the cluster size dependence and poor specificity of DE nominated genes are separate problems. Genes nominated under default settings were substantially less specific to their target clusters, with median on-target fractions of 0.204 (lung), 0.166 (kidney), and 0.083 (brain), compared to NS-Forest's marker genes (0.580, 0.687, 0.364), revealing the relatively poor specificity that highly scoring DE genes exhibit.
ER -