Clinical expertise and cognitive reflection predict fewer misconceptions in Bayesian diagnostic reasoning
- 1Department of Psychology, Bielefeld University
- 2Department of Urology, Franziskus Hospital
Abstract
Background For many years, research has consistently confirmed that even medical experts fail to solve Bayesian diagnostic tasks. These tasks require correctly estimating a diagnostic test’s positive predictive value based on sensitivity, specificity, and the disease’s prevalence. Previous research has primarily focused on improving task presentation, for example by using natural frequencies or visual aids. The present study introduces the Medical Bayesian Performance Score (MBPS), a confidence-weighted measure that distinguishes confidently held misconceptions from missing concepts. Participants completed eight medical Bayesian diagnostic tasks and rated their confidence after each response. Using this approach, we examined whether medical knowledge, clinical expertise, and cognitive reflection are associated with performance in Bayesian diagnostic reasoning. Methods In an online survey, we compared MBPS values via t tests along two independent variables: (a) medical knowledge (physician group: N p = 30 vs. student control group: N s = 56) and (b) clinical expertise within the physician group (specialists and senior physicians: N e = 19 vs. resident physicians: N r = 11). Furthermore, we analyzed correlations between MBPS values and Cognitive Reflection Test (CRT) scores. Results Physicians did not achieve significantly higher MBPS values than the student control group. In contrast, specialists and senior physicians scored significantly higher than resident physicians. Across all groups, average MBPS values were negative, indicating that confidence-weighted incorrect responses outweighed confidence-weighted correct responses, a pattern consistent with misconceptions. Furthermore, higher CRT scores correlated significantly with higher MBPS values. Conclusions The MBPS provides a complementary perspective to conventional accuracy measures by distinguishing misconceptions from missing concepts and linking Bayesian diagnostic reasoning research with conceptual change theory. Consistent with this perspective, our findings suggest that formal medical knowledge alone was not associated with fewer misconceptions, whereas greater clinical expertise and higher cognitive reflection were. Future research should evaluate evidence-based conceptual change interventions for medical education, such as specific refutation-based training, as a means of improving Bayesian diagnostic reasoning.
Related
- Assessing diagnostic performance for common skin diseases using an AI-assisted tele-expertise platform: a proof of concept
- Effects of reflection-through-action on collaborative clinical reasoning skills in an emergency dental simulation
- Preserving Clinical Reasoning in ChatGPT-Integrated Medical Education: From AI Use to Cognitive Engagement.
- Information theory and diagnostic reasoning in primary care: a framework for navigating uncertainty.
- Stroke-Heart Syndrome: Mechanisms, Temporal Phenotypes, and Diagnostic Reasoning.
BibTeX
@article{hefter2026clinical,
title = {{Clinical expertise and cognitive reflection predict fewer misconceptions in Bayesian diagnostic reasoning}},
author = {Markus H. Hefter and Nathan B. Hinkel and Andreas Hinkel},
journal = {BMC Medical Education},
year = {2026},
month = nov,
doi = {10.1186/s12909-026-10764-z},
url = {https://doi.org/10.1186/s12909-026-10764-z},
note = {CC BY},
}
RIS
TY - JOUR
TI - Clinical expertise and cognitive reflection predict fewer misconceptions in Bayesian diagnostic reasoning
AU - Markus H. Hefter
AU - Nathan B. Hinkel
AU - Andreas Hinkel
PY - 2026
DA - 2026/11/08
JO - BMC Medical Education
DO - 10.1186/s12909-026-10764-z
UR - https://doi.org/10.1186/s12909-026-10764-z
AB - Background For many years, research has consistently confirmed that even medical experts fail to solve Bayesian diagnostic tasks. These tasks require correctly estimating a diagnostic test’s positive predictive value based on sensitivity, specificity, and the disease’s prevalence. Previous research has primarily focused on improving task presentation, for example by using natural frequencies or visual aids. The present study introduces the Medical Bayesian Performance Score (MBPS), a confidence-weighted measure that distinguishes confidently held misconceptions from missing concepts. Participants completed eight medical Bayesian diagnostic tasks and rated their confidence after each response. Using this approach, we examined whether medical knowledge, clinical expertise, and cognitive reflection are associated with performance in Bayesian diagnostic reasoning. Methods In an online survey, we compared MBPS values via t tests along two independent variables: (a) medical knowledge (physician group: N p = 30 vs. student control group: N s = 56) and (b) clinical expertise within the physician group (specialists and senior physicians: N e = 19 vs. resident physicians: N r = 11). Furthermore, we analyzed correlations between MBPS values and Cognitive Reflection Test (CRT) scores. Results Physicians did not achieve significantly higher MBPS values than the student control group. In contrast, specialists and senior physicians scored significantly higher than resident physicians. Across all groups, average MBPS values were negative, indicating that confidence-weighted incorrect responses outweighed confidence-weighted correct responses, a pattern consistent with misconceptions. Furthermore, higher CRT scores correlated significantly with higher MBPS values. Conclusions The MBPS provides a complementary perspective to conventional accuracy measures by distinguishing misconceptions from missing concepts and linking Bayesian diagnostic reasoning research with conceptual change theory. Consistent with this perspective, our findings suggest that formal medical knowledge alone was not associated with fewer misconceptions, whereas greater clinical expertise and higher cognitive reflection were. Future research should evaluate evidence-based conceptual change interventions for medical education, such as specific refutation-based training, as a means of improving Bayesian diagnostic reasoning.
SN - 1472-6920
ER -