Degree bias predicts, outperforms and improves machine learning phage-host interaction predictions
- 1Vrije Universiteit Amsterdam
Abstract
Phages are promising therapeutics for difficult-to-treat bacterial infections. However, phages are highly specific in which bacterial strains they infect, necessitating extensive experimental screening for each patient isolate. Machine learning (ML) models predicting phage-host interactions from genomes are increasingly developed to prioritize phages for experimental screening. The Area Under the Receiver Operating Characteristic (AUROC) metric is standard for model evaluation, with reported high scores (0.7-0.95) suggesting strong predictive power. However, because phage-bacterium networks are highly structured, these scores can be inflated by "degree bias", the baseline likelihood of infection driven purely by average phage infectivity and bacterial susceptibility. Here, we show that an interaction-naive model based solely on network degrees accurately predicts and outperforms the global AUROC scores of five published ML models across ten datasets, indicating that global AUROC primarily reflects network structure rather than predicted interactions. Using randomized degree-conserved networks and degree-stratified evaluation, we isolate true interaction predictions and demonstrate that current ML model performance is far more modest than global AUROC suggests. Finally, we demonstrate that regressing out degree bias from training data improves interaction predictability and boosts global and stratified performance. Our work provides a critical framework for model evaluation and a straightforward route to improve ML-guided phage selection.
Related
- Learning from Error Predictions Rather Than Prediction Errors: A Perspective on Self-Supervised Learning in the Brain
- SpectroVQ: Noise-Aware Compression of Proteomics Data via Vector-Quantized Deep Learning improves MS/MS data storage and Peptide Identification
- Integrating bacterial and viral genomic information enhances and extends the machine learning predictions of bacteriophage activity against pathogenic Escherichia coli
- Decoding antibody-antigen recognition: the BL8 language and its application in calibrating deep learning predictions
- Advancing grapevine phenology predictions: a comparison of regression-based statistical learning approach and conventional models in mediterranean environment.
BibTeX
@misc{jeuken2026degree,
title = {{Degree bias predicts, outperforms and improves machine learning phage-host interaction predictions}},
author = {G. S. Jeuken and Y. Mulla},
howpublished = {bioRxiv},
year = {2026},
month = oct,
doi = {10.64898/2026.10.29.762857},
url = {https://www.biorxiv.org/content/10.64898/2026.10.29.762857v1},
note = {CC BY},
}
RIS
TY - UNPB
TI - Degree bias predicts, outperforms and improves machine learning phage-host interaction predictions
AU - G. S. Jeuken
AU - Y. Mulla
PY - 2026
DA - 2026/10/29
PB - bioRxiv
DO - 10.64898/2026.10.29.762857
UR - https://www.biorxiv.org/content/10.64898/2026.10.29.762857v1
AB - Phages are promising therapeutics for difficult-to-treat bacterial infections. However, phages are highly specific in which bacterial strains they infect, necessitating extensive experimental screening for each patient isolate. Machine learning (ML) models predicting phage-host interactions from genomes are increasingly developed to prioritize phages for experimental screening. The Area Under the Receiver Operating Characteristic (AUROC) metric is standard for model evaluation, with reported high scores (0.7-0.95) suggesting strong predictive power. However, because phage-bacterium networks are highly structured, these scores can be inflated by "degree bias", the baseline likelihood of infection driven purely by average phage infectivity and bacterial susceptibility. Here, we show that an interaction-naive model based solely on network degrees accurately predicts and outperforms the global AUROC scores of five published ML models across ten datasets, indicating that global AUROC primarily reflects network structure rather than predicted interactions. Using randomized degree-conserved networks and degree-stratified evaluation, we isolate true interaction predictions and demonstrate that current ML model performance is far more modest than global AUROC suggests. Finally, we demonstrate that regressing out degree bias from training data improves interaction predictability and boosts global and stratified performance. Our work provides a critical framework for model evaluation and a straightforward route to improve ML-guided phage selection.
ER -