Diagnostic performance of chat generative pre-trained transformer in detecting silicone implant rupture on breast magnetic resonance imaging.
- 1Department of Radiology, Tel Aviv University, Sackler School of Medicine, Sourasky Medical Center, Tel Aviv, Israel.
- 2Department of Radiology, University of Toronto, Joint Department of Medical, Toronto, Canada.
Abstract
Objectives
The aim of this study was to compare the diagnostic performance of chat generative pre-trained transformer (ChatGPT) and breast radiologists in detecting silicone implant rupture on breast magnetic resonance imaging (MRI).Material and methods
In this retrospective study, 94 breast MRI examinations performed in 2023 for evaluation of silicone implant integrity were reviewed, yielding 188 implants (41 ruptured, 147 intact). For each examination, a single bilateral silicone-specific MRI image was selected. ChatGPT (GPT-5.2 with Auto model selection enabled) and two board-certified breast radiologists independently classified each implant as intact or ruptured using the same image. Cases were categorized as easy or difficult based on predefined imaging criteria. Diagnostic performance metrics with 95% confidence intervals (CI) were calculated, and comparisons between ChatGPT and radiologists were performed using generalized estimating equations. Agreement between the initial and repeat ChatGPT testing sessions was assessed using Cohen's κ.Results
ChatGPT achieved an overall accuracy of 90% (95% CI: 86-95%), sensitivity of 81% (67-92%), and specificity of 93% (88-97%) for detecting silicone implant rupture. In difficulty-stratified analysis, performance was near perfect in easy cases but declined substantially in difficult cases, with sensitivity decreasing from 100% to 62%. The senior radiologist demonstrated significantly higher diagnostic performance than ChatGPT, with 98% accuracy (95% CI: 96-100%), 98% sensitivity (92-100%), and 99% specificity (97-100%). The junior radiologist also showed higher overall accuracy than ChatGPT (odds ratio 3.2, 95% CI: 1.3-8.2). Agreement between the initial and repeat ChatGPT testing sessions was substantial (κ = 0.70).Conclusion
ChatGPT showed good performance in detecting silicone implant rupture on selected silicone-specific breast MRI images using a radiologist-consensus reference standard, particularly in cases with clear imaging findings. However, reduced accuracy in challenging cases and incomplete agreement between testing sessions highlight important limitations. Future advances, particularly analysis of complete imaging datasets, may improve clinical utility.
Related
- Diagnostic Performance of Clinical Examination for Detecting Knee Effusion: Impact of Obesity and Periarticular Adiposity
- Diagnostic Performance of Color Doppler Ultrasound for Detecting Nuchal Cord and Associated Immediate Neonatal Outcomes at Term in Uganda: A Prospective Diagnostic‐Accuracy Cohort Study
- Diagnostic Performance of a Deep Learning Model Using Phonocardiogram and Single‐Lead ECG Signals for Detecting Moderate‐or‐Greater Aortic Stenosis: Multicenter External Validation
- Magnetic Resonance Imaging in the Preoperative Assessment of Anal Fistula: Diagnostic Performance and Comparison of the St. James and Garg Classifications
- Diagnostic performance of FIB-4 in detecting advanced liver fibrosis in patients with rheumatoid arthritis, psoriatic arthritis and psoriasis using methotrexate.
BibTeX
@article{maudahavakuk2026diagnostic,
title = {{Diagnostic performance of chat generative pre-trained transformer in detecting silicone implant rupture on breast magnetic resonance imaging.}},
author = {Michal Mauda-Havakuk and Orit Golan and Vivianne A R Freitas and Alina Filyavich and Sophie Diai and Rina Neeman and Diego Gabriel Mercer and Yoav Amitai},
journal = {Journal of clinical imaging science},
year = {2026},
month = oct,
doi = {10.25259/jcis_132_2026},
url = {https://europepmc.org/article/MED/42974285},
note = {CC BY-NC-SA},
}
RIS
TY - JOUR
TI - Diagnostic performance of chat generative pre-trained transformer in detecting silicone implant rupture on breast magnetic resonance imaging.
AU - Michal Mauda-Havakuk
AU - Orit Golan
AU - Vivianne A R Freitas
AU - Alina Filyavich
AU - Sophie Diai
AU - Rina Neeman
AU - Diego Gabriel Mercer
AU - Yoav Amitai
PY - 2026
DA - 2026/10/22
JO - Journal of clinical imaging science
DO - 10.25259/jcis_132_2026
UR - https://europepmc.org/article/MED/42974285
AB - Objectives The aim of this study was to compare the diagnostic performance of chat generative pre-trained transformer (ChatGPT) and breast radiologists in detecting silicone implant rupture on breast magnetic resonance imaging (MRI).Material and methods In this retrospective study, 94 breast MRI examinations performed in 2023 for evaluation of silicone implant integrity were reviewed, yielding 188 implants (41 ruptured, 147 intact). For each examination, a single bilateral silicone-specific MRI image was selected. ChatGPT (GPT-5.2 with Auto model selection enabled) and two board-certified breast radiologists independently classified each implant as intact or ruptured using the same image. Cases were categorized as easy or difficult based on predefined imaging criteria. Diagnostic performance metrics with 95% confidence intervals (CI) were calculated, and comparisons between ChatGPT and radiologists were performed using generalized estimating equations. Agreement between the initial and repeat ChatGPT testing sessions was assessed using Cohen's κ.Results ChatGPT achieved an overall accuracy of 90% (95% CI: 86-95%), sensitivity of 81% (67-92%), and specificity of 93% (88-97%) for detecting silicone implant rupture. In difficulty-stratified analysis, performance was near perfect in easy cases but declined substantially in difficult cases, with sensitivity decreasing from 100% to 62%. The senior radiologist demonstrated significantly higher diagnostic performance than ChatGPT, with 98% accuracy (95% CI: 96-100%), 98% sensitivity (92-100%), and 99% specificity (97-100%). The junior radiologist also showed higher overall accuracy than ChatGPT (odds ratio 3.2, 95% CI: 1.3-8.2). Agreement between the initial and repeat ChatGPT testing sessions was substantial (κ = 0.70).Conclusion ChatGPT showed good performance in detecting silicone implant rupture on selected silicone-specific breast MRI images using a radiologist-consensus reference standard, particularly in cases with clear imaging findings. However, reduced accuracy in challenging cases and incomplete agreement between testing sessions highlight important limitations. Future advances, particularly analysis of complete imaging datasets, may improve clinical utility.
SN - 2156-7514
SN - 2156-5597
ER -