Comparative performance of Gemini and DeepSeek large language models in surgical decision support for mastoidectomy in chronic otitis media with cholesteatoma.
- 1Department of Otolaryngology, Faculty of Medicine, Zonguldak Bülent Ecevit University, Zonguldak, Türkiye.
Abstract
Objective
To compare the clinical accuracy of two state-of-the-art Large Language Models (LLMs), Gemini Pro v3.1 and DeepSeek v3.2, in providing surgical decision support and postoperative management for mastoidectomy using expert-validated real patient data.Methods
A retrospective analysis included 121 mastoidectomy cases performed for chronic otitis media with cholesteatoma. Clinical case scenarios, including otoscopy, pure-tone audiometry, and radiological findings, were presented to both models. AI-generated responses were evaluated using a 100-point scoring system developed by four otolaryngologists in two domains: surgical planning and postoperative management. Paired-sample t-tests compared model performance, while Mann-Whitney U and Kruskal-Wallis tests assessed the effects of clinical variables.Results
No significant difference was found between Gemini and DeepSeek in surgical planning (76.07% vs. 73.97%, p = 0.258). However, Gemini significantly outperformed DeepSeek in postoperative management (67.85% vs. 62.11%, p = 0.001). Both models achieved significantly higher scores in surgical planning than postoperative care. DeepSeek demonstrated significantly higher surgical accuracy in patients with comorbidities (p = 0.004) and postoperative complications (p < 0.001). Surgical approach significantly influenced DeepSeek's performance (p = 0.001), with better results in microscopic than endoscopic cases.Conclusion
Both LLMs performed well in surgical planning but were less effective in postoperative management. Gemini demonstrated superior performance in postoperative recommendations, whereas DeepSeek benefited from clearer indicators of disease severity. These findings support the potential of LLMs as adjunctive tools in otologic surgical decision-making while emphasizing the need for expert clinical oversight.
Related
- Comparative Evaluation of ChatGPT, DeepSeek, and Physician-Generated Acupuncture Treatment Protocols Across Chinese and English Language Settings: Cross-Sectional Evaluation Study.
- Performance of large language models in prescription review: a comparative study
- Benchmarking the performance of large language models on medical genetics questions: a comparative evaluation of GPT-5.1, Gemini Pro 3, and Claude Opus 4.5.
- Comparative performance of nine large language models on professional Parkinson’s disease tasks: a multidimensional benchmark study
- Performance of large language models in providing patient- oriented information on gingival recession: a comparative study.
BibTeX
@article{isık2026comparative,
title = {{Comparative performance of Gemini and DeepSeek large language models in surgical decision support for mastoidectomy in chronic otitis media with cholesteatoma.}},
author = {Hüseyin Işık and Deniz Baklacı and Gökhan Furkan Kılıç and Seda Nur Saka and Duygu Erdem},
journal = {Frontiers in neurology},
year = {2026},
month = oct,
doi = {10.3389/fneur.2026.1959170},
url = {https://europepmc.org/article/MED/42908837},
note = {CC BY},
}
RIS
TY - JOUR
TI - Comparative performance of Gemini and DeepSeek large language models in surgical decision support for mastoidectomy in chronic otitis media with cholesteatoma.
AU - Hüseyin Işık
AU - Deniz Baklacı
AU - Gökhan Furkan Kılıç
AU - Seda Nur Saka
AU - Duygu Erdem
PY - 2026
DA - 2026/10/07
JO - Frontiers in neurology
DO - 10.3389/fneur.2026.1959170
UR - https://europepmc.org/article/MED/42908837
AB - Objective To compare the clinical accuracy of two state-of-the-art Large Language Models (LLMs), Gemini Pro v3.1 and DeepSeek v3.2, in providing surgical decision support and postoperative management for mastoidectomy using expert-validated real patient data.Methods A retrospective analysis included 121 mastoidectomy cases performed for chronic otitis media with cholesteatoma. Clinical case scenarios, including otoscopy, pure-tone audiometry, and radiological findings, were presented to both models. AI-generated responses were evaluated using a 100-point scoring system developed by four otolaryngologists in two domains: surgical planning and postoperative management. Paired-sample t-tests compared model performance, while Mann-Whitney U and Kruskal-Wallis tests assessed the effects of clinical variables.Results No significant difference was found between Gemini and DeepSeek in surgical planning (76.07% vs. 73.97%, p = 0.258). However, Gemini significantly outperformed DeepSeek in postoperative management (67.85% vs. 62.11%, p = 0.001). Both models achieved significantly higher scores in surgical planning than postoperative care. DeepSeek demonstrated significantly higher surgical accuracy in patients with comorbidities (p = 0.004) and postoperative complications (p < 0.001). Surgical approach significantly influenced DeepSeek's performance (p = 0.001), with better results in microscopic than endoscopic cases.Conclusion Both LLMs performed well in surgical planning but were less effective in postoperative management. Gemini demonstrated superior performance in postoperative recommendations, whereas DeepSeek benefited from clearer indicators of disease severity. These findings support the potential of LLMs as adjunctive tools in otologic surgical decision-making while emphasizing the need for expert clinical oversight.
SN - 1664-2295
ER -