Deep Learning-Assisted Diagnosis of Middle Ear Diseases in Otoendoscopy Across Clinician Experience Levels: Retrospective Reader Study.
- 1Department of Otorhinolaryngology-Head and Neck Surgery, Asan Medical Center, University of Ulsan College of Medicine, 88 Olympic-ro 43-gil, Songpa-gu, Seoul, 05505, Republic of Korea, 82 2-3010-3717, 82 2-489-2773.
- 2Department of Medical Science, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.
- 3Department of Biomedical Engineering, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.
Abstract
Background
Accurate diagnosis of middle ear diseases remains challenging due to the specialized nature of otoscopic interpretation and the global shortage of otolaryngologists.Objective
We aimed to evaluate the impact of a deep learning-based AI support system on the diagnostic performance of clinicians with varying levels of expertise, specifically focusing on its ability to bridge the gap between trainees and experts.Methods
In this retrospective reader study, a deep learning model (EfficientNet-B4) was developed using a large-scale dataset of 7335 endoscopic images. The model was designed for multi-class classification, simultaneously identifying primary categories (chronic otitis media, otitis media with effusion, or none [indicating the absence of the first two]) and secondary features (attic retraction, myringitis, otomycosis, and ventilation tube). To assess clinical impact, diagnostic performance was compared among 3 otology professors, 5 senior residents, and 5 junior residents using an independent clinical assessment set of 100 images. Participants performed diagnoses both with and without AI-generated predictions, with a time constraint of 1 minute per image to simulate real-world clinical pressure.Results
In 5-fold cross-validation, the deep learning model achieved 94.8% accuracy for the primary classification. The stand-alone AI achieved diagnostic accuracies ranging from 94.0% to 99.0% in the clinical assessment set. AI support significantly enhanced diagnostic accuracy across all groups for primary classification, with improvements of 11.0% for otology professors, 28.8% for senior residents, and 32.2% for junior residents (P<.001). Accuracy increased from 78.7% to 89.7% for otology professors, from 65.0% to 93.8% for senior residents, and from 54.4% to 86.6% for junior residents. The accuracy gap between the most experienced (otology professors) and least experienced (junior residents) groups was reduced from 24.3% to 3.1%. For secondary categories, significant improvements were observed in diagnosing attic retraction and myringitis among residents. AI-supported accuracy for attic retraction was higher in senior residents than that of the stand-alone AI, although the 95% CIs overlapped substantially, so the difference was not statistically significant.Conclusions
Our findings demonstrate that deep learning-based AI support substantially improves the diagnostic accuracy of middle ear diseases, particularly for less experienced clinicians. By narrowing the performance gap between trainees and experts, this system shows high potential as a valuable adjunct for clinical decision-making and medical education in otology.
Related
- Optimizing the Patient Experience Through Clinician Coaching or Communication Intervention: A Randomized Pilot Study
- Complementary Health Approach Use Among Adults Reporting a Clinician Diagnosis of Chronic Fatigue Syndrome in a US Online Quota Sample
- Clinician Bias and Patient Experience in Cancer Genetic Counseling
- Challenges in cancer diagnosis in Somalia through 35 years of instability (1991–2025): a pathologist’s experience
- Adherencia a la vigilancia del carcinoma hepatocelular y su asociación con el estadio tumoral al diagnóstico: experiencia de un hospital universitario Adherence to Hepatocellular Carcinoma Surveillance and Its Association with Tumor Stage at Diagnosis: Experience at a University Hospital
BibTeX
@article{yi2026deep,
title = {{Deep Learning-Assisted Diagnosis of Middle Ear Diseases in Otoendoscopy Across Clinician Experience Levels: Retrospective Reader Study.}},
author = {Se Eun Yi and Jihye Chae and Keunwoo Park and Yeon Joo Choi and Jihoon Kweon and Joong Ho Ahn},
journal = {JMIR medical informatics},
year = {2026},
month = oct,
doi = {10.2196/96134},
url = {https://europepmc.org/article/MED/42963056},
note = {CC BY},
}
RIS
TY - JOUR
TI - Deep Learning-Assisted Diagnosis of Middle Ear Diseases in Otoendoscopy Across Clinician Experience Levels: Retrospective Reader Study.
AU - Se Eun Yi
AU - Jihye Chae
AU - Keunwoo Park
AU - Yeon Joo Choi
AU - Jihoon Kweon
AU - Joong Ho Ahn
PY - 2026
DA - 2026/10/30
JO - JMIR medical informatics
DO - 10.2196/96134
UR - https://europepmc.org/article/MED/42963056
AB - Background Accurate diagnosis of middle ear diseases remains challenging due to the specialized nature of otoscopic interpretation and the global shortage of otolaryngologists.Objective We aimed to evaluate the impact of a deep learning-based AI support system on the diagnostic performance of clinicians with varying levels of expertise, specifically focusing on its ability to bridge the gap between trainees and experts.Methods In this retrospective reader study, a deep learning model (EfficientNet-B4) was developed using a large-scale dataset of 7335 endoscopic images. The model was designed for multi-class classification, simultaneously identifying primary categories (chronic otitis media, otitis media with effusion, or none [indicating the absence of the first two]) and secondary features (attic retraction, myringitis, otomycosis, and ventilation tube). To assess clinical impact, diagnostic performance was compared among 3 otology professors, 5 senior residents, and 5 junior residents using an independent clinical assessment set of 100 images. Participants performed diagnoses both with and without AI-generated predictions, with a time constraint of 1 minute per image to simulate real-world clinical pressure.Results In 5-fold cross-validation, the deep learning model achieved 94.8% accuracy for the primary classification. The stand-alone AI achieved diagnostic accuracies ranging from 94.0% to 99.0% in the clinical assessment set. AI support significantly enhanced diagnostic accuracy across all groups for primary classification, with improvements of 11.0% for otology professors, 28.8% for senior residents, and 32.2% for junior residents (P<.001). Accuracy increased from 78.7% to 89.7% for otology professors, from 65.0% to 93.8% for senior residents, and from 54.4% to 86.6% for junior residents. The accuracy gap between the most experienced (otology professors) and least experienced (junior residents) groups was reduced from 24.3% to 3.1%. For secondary categories, significant improvements were observed in diagnosing attic retraction and myringitis among residents. AI-supported accuracy for attic retraction was higher in senior residents than that of the stand-alone AI, although the 95% CIs overlapped substantially, so the difference was not statistically significant.Conclusions Our findings demonstrate that deep learning-based AI support substantially improves the diagnostic accuracy of middle ear diseases, particularly for less experienced clinicians. By narrowing the performance gap between trainees and experts, this system shows high potential as a valuable adjunct for clinical decision-making and medical education in otology.
SN - 2291-9694
ER -