Count your bits: fingerprint benchmarking to assess broad chemical space representation
- 1Centre for Digitalisation and Digitality, Düsseldorf University of Applied Sciences, Düsseldorf, Germany
Abstract
Quantifying molecular similarity is a cornerstone of cheminformatics, underpinning applications from virtual screening and nearest-neighbor search to chemical space visualization and the evaluation of machine-learning predictions. Yet, despite widespread use of Tanimoto comparisons of 2D fingerprints, the practical behavior of these similarity measures depends strongly on the fingerprint type, representation (binary vs. count), and whether fingerprints are folded into fixed-length vectors. In this work, our main goal is to provide a broad and systematic comparison of common fingerprint types, including dictionary-based, circular (Morgan/FCFP), path-based (RDKit), topological-distance-based (Atom Pair), hybrid distance-encoded (MAP4), torsion, LINGO, and Avalon, together with several representation variants. We benchmark these fingerprints across multiple large and heterogeneous datasets using complementary evaluation tasks that probe specificity, score distributions, compound-size dependence, top-k ranking agreement, and compare fingerprint similarities to a graph-based reference. Across benchmarks, count and often log-count variants generally improve specificity and structural alignment, while folding-induced bit collisions can strongly distort similarities for high-occupancy fingerprints, making unfolded variants particularly important for RDKit and often necessary for MAP4 on heterogeneous datasets. To support reproducible benchmarking and future extensions, we also introduce the open-source Python library chemap, which provides unified computation of folded, unfolded, and frequency-folded fingerprints together with optimized similarity calculations.Scientific contributionWe introduce a multi-criteria benchmarking framework for molecular fingerprints that goes beyond classical virtual-screening retrieval tests by evaluating specificity (fingerprint duplicates), score behavior (including compound-size dependence), ranking agreement, and neighborhood structure on large, heterogeneous small-molecule datasets. Our results reveal that common default settings, especially folding for high-occupancy fingerprints, can introduce severe bit-collision artifacts, and that count (often log-count) and unfolded variants substantially improve specificity and agreement with structure-based references. We release the open-source Python library chemap to standardize these fingerprint variants and enable reproducible, extensible benchmarking for future fingerprint development.
Related
- Auditing frozen chemical language model embeddings for drug-delivery screening: fingerprint baselines, random-initialization controls, and scaffold-memorization control tasks
- Representing chemical and enzymatic reactions in fingerprint space for applicability filtering and classification
- Solvent-Dependent Selective Retention of Essential-Oil Markers and Modification of the Thymol-Type Chemical Fingerprint in Post-Extraction Thymus vulgaris L. Biomass
- Multimodal Representation Learning for Exploring Natural Product Chemical Space
- UniPert-G2CP bridges genetic and chemical screens from molecular representation to phenotype modeling
BibTeX
@article{huber2026count,
title = {{Count your bits: fingerprint benchmarking to assess broad chemical space representation}},
author = {Florian Huber and Julian Pollmann},
journal = {Journal of Cheminformatics},
year = {2026},
month = jun,
doi = {10.1186/s13321-026-01245-y},
url = {https://doi.org/10.1186/s13321-026-01245-y},
note = {CC BY},
}
RIS
TY - JOUR
TI - Count your bits: fingerprint benchmarking to assess broad chemical space representation
AU - Florian Huber
AU - Julian Pollmann
PY - 2026
DA - 2026/06/30
JO - Journal of Cheminformatics
DO - 10.1186/s13321-026-01245-y
UR - https://doi.org/10.1186/s13321-026-01245-y
AB - Quantifying molecular similarity is a cornerstone of cheminformatics, underpinning applications from virtual screening and nearest-neighbor search to chemical space visualization and the evaluation of machine-learning predictions. Yet, despite widespread use of Tanimoto comparisons of 2D fingerprints, the practical behavior of these similarity measures depends strongly on the fingerprint type, representation (binary vs. count), and whether fingerprints are folded into fixed-length vectors. In this work, our main goal is to provide a broad and systematic comparison of common fingerprint types, including dictionary-based, circular (Morgan/FCFP), path-based (RDKit), topological-distance-based (Atom Pair), hybrid distance-encoded (MAP4), torsion, LINGO, and Avalon, together with several representation variants. We benchmark these fingerprints across multiple large and heterogeneous datasets using complementary evaluation tasks that probe specificity, score distributions, compound-size dependence, top-k ranking agreement, and compare fingerprint similarities to a graph-based reference. Across benchmarks, count and often log-count variants generally improve specificity and structural alignment, while folding-induced bit collisions can strongly distort similarities for high-occupancy fingerprints, making unfolded variants particularly important for RDKit and often necessary for MAP4 on heterogeneous datasets. To support reproducible benchmarking and future extensions, we also introduce the open-source Python library chemap, which provides unified computation of folded, unfolded, and frequency-folded fingerprints together with optimized similarity calculations.Scientific contributionWe introduce a multi-criteria benchmarking framework for molecular fingerprints that goes beyond classical virtual-screening retrieval tests by evaluating specificity (fingerprint duplicates), score behavior (including compound-size dependence), ranking agreement, and neighborhood structure on large, heterogeneous small-molecule datasets. Our results reveal that common default settings, especially folding for high-occupancy fingerprints, can introduce severe bit-collision artifacts, and that count (often log-count) and unfolded variants substantially improve specificity and agreement with structure-based references. We release the open-source Python library chemap to standardize these fingerprint variants and enable reproducible, extensible benchmarking for future fingerprint development.
SN - 1758-2946
ER -