Peer-reviewedCC BY 4.0PLOS Digital Health
When the algorithm passes the test but fails the patient
- 1Makerere University, School of Public Health, Kampala, Uganda
Abstract
Tens of thousands of AI diagnostic tools have been authorised for clinical diagnosis worldwide, justified primarily by benchmark accuracy (performance on a fixed, curated test dataset), a number that says little about what the tool will do at the bedside. The field rests on three flawed foundations: datasets that do not reflect the populations served, development pipelines that exclude clinicians, and regulatory pathways that mistake on-paper accuracy for evidence of benefit. Closing the gap requires global coordination and the political will to treat clinical validation as a prerequisite rather than an afterthought.
Related
- When the Cytoskeleton Fails: Primary Structural Defects Underlying Disorders with Neurological Involvement
- A Connectome Test of the Fly Hashing Algorithm
- To be or not to appear tired: When the « good patient » takes the stage
- In vivo CAR-T cells: When the patient becomes their own factory
- Patient experiences with hereditary cancer genetic test result release in the setting of the 21st Century Cures Act final rule
BibTeX
@article{mirugwe2026when,
title = {{When the algorithm passes the test but fails the patient}},
author = {Alex Mirugwe},
journal = {PLOS Digital Health},
year = {2026},
month = oct,
doi = {10.1371/journal.pdig.0001774},
url = {https://journals.plos.org/digitalhealth/article?id=10.1371/journal.pdig.0001774},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - When the algorithm passes the test but fails the patient
AU - Alex Mirugwe
PY - 2026
DA - 2026/10/06
JO - PLOS Digital Health
DO - 10.1371/journal.pdig.0001774
UR - https://journals.plos.org/digitalhealth/article?id=10.1371/journal.pdig.0001774
AB - Tens of thousands of AI diagnostic tools have been authorised for clinical diagnosis worldwide, justified primarily by benchmark accuracy (performance on a fixed, curated test dataset), a number that says little about what the tool will do at the bedside. The field rests on three flawed foundations: datasets that do not reflect the populations served, development pipelines that exclude clinicians, and regulatory pathways that mistake on-paper accuracy for evidence of benefit. Closing the gap requires global coordination and the political will to treat clinical validation as a prerequisite rather than an afterthought.
SN - 2767-3170
ER -