Laemple: A Benchmarking Framework for Virus Lineage Deconvolution Tools for SARS-CoV-2 from Wastewater
- 1Ludwig Boltzmann Institute for Science Outreach and Pandemic Preparedness at the Medical University
Abstract
1BackgroundCorrect and accurate deconvolution of SARS-CoV-2 lineages from wastewater sequencing data is a challenging task, given the intricacy of wastewater amplicon-sequencing data and the ever-growing complexity of the lineage classification. Existing benchmarking studies made use of artificial spike-in compositions, thereby falling short of reflecting the prevailing complexity of wastewater samples.
ResultsWe present a modular, expandable, simulation-based benchmarking framework as a reproducible Snakemake workflow, named Laemple, to evaluate the performance of virus lineage deconvolution tools. Using in silico simulated data sets of varying complexity and sequencing quality, we demonstrate its utility by evaluating seven publicly available tools, based on their precision, sensitivity, and reproducibility. Freyja showed robust sensitivity and consistent performance across diverse data set complexities, alongside user-friendly installation and documentation, while VaQuERo demonstrated the highest precision.
ConclusionsOur results reveal substantial variation in tool performance across conditions, emphasizing the need to benchmark with diverse and complex scenarios. This framework enables informed tool selection for researchers and public health agencies and allows developers to stress-test their tools during development and maintenance, i.e., updating the lineage definition for newly emerging virus lineages. To this end, Laemple was designed in a modular fashion for customization and future expansion to support ongoing software development across all stages of the application life-cycle management.
Related
- Læmple: a benchmarking framework for virus lineage deconvolution tools for SARS-CoV-2 from wastewater.
- Developing and benchmarking one health genomic surveillance tools for influenza A virus in wastewater
- A 16S rRNA-Based Screening Framework Reveals Distinct Microbial and Antimicrobial Resistance-Related Fingerprints in Aquaculture and Municipal Wastewater Effluents
- Unifying Vision and Language: Benchmarking End to End Transformer Model Against the ClipCap Framework
- Cross-lineage anomaly detection of microRNA expression: a framework for deriving exploratory candidate biomarkers in sarcoma.
BibTeX
@misc{schedl2026laemple,
title = {{Laemple: A Benchmarking Framework for Virus Lineage Deconvolution Tools for SARS-CoV-2 from Wastewater}},
author = {A. Schedl and A. Bergthaler and F. Amman},
howpublished = {medRxiv},
year = {2026},
month = sep,
doi = {10.64898/2026.09.02.26362081},
url = {https://www.medrxiv.org/content/10.64898/2026.09.02.26362081v1},
note = {CC BY-NC},
}
RIS
TY - UNPB
TI - Laemple: A Benchmarking Framework for Virus Lineage Deconvolution Tools for SARS-CoV-2 from Wastewater
AU - A. Schedl
AU - A. Bergthaler
AU - F. Amman
PY - 2026
DA - 2026/09/02
PB - medRxiv
DO - 10.64898/2026.09.02.26362081
UR - https://www.medrxiv.org/content/10.64898/2026.09.02.26362081v1
AB - 1BackgroundCorrect and accurate deconvolution of SARS-CoV-2 lineages from wastewater sequencing data is a challenging task, given the intricacy of wastewater amplicon-sequencing data and the ever-growing complexity of the lineage classification. Existing benchmarking studies made use of artificial spike-in compositions, thereby falling short of reflecting the prevailing complexity of wastewater samples. ResultsWe present a modular, expandable, simulation-based benchmarking framework as a reproducible Snakemake workflow, named Laemple, to evaluate the performance of virus lineage deconvolution tools. Using in silico simulated data sets of varying complexity and sequencing quality, we demonstrate its utility by evaluating seven publicly available tools, based on their precision, sensitivity, and reproducibility. Freyja showed robust sensitivity and consistent performance across diverse data set complexities, alongside user-friendly installation and documentation, while VaQuERo demonstrated the highest precision. ConclusionsOur results reveal substantial variation in tool performance across conditions, emphasizing the need to benchmark with diverse and complex scenarios. This framework enables informed tool selection for researchers and public health agencies and allows developers to stress-test their tools during development and maintenance, i.e., updating the lineage definition for newly emerging virus lineages. To this end, Laemple was designed in a modular fashion for customization and future expansion to support ongoing software development across all stages of the application life-cycle management.
ER -