Spatially Grounded Neurosymbolic AI for Explainable Retinal Disease Classification From OCT Images
- 1Department of Medicine, Surgery and Health Sciences, Ophthalmology Clinic, University of Trieste, Italy
- 2Institute for Maternal and Child Health IRCCS “Burlo Garofolo,” Italy
- 3Department of Engineering and Architecture, University of Trieste, Italy
Abstract
Purpose: To develop and evaluate a spatially grounded neurosymbolic AI framework for explainable multilabel retinal disease classification from optical coherence tomography (OCT) images, integrating convolutional neural network (CNN)–based retinal sign extraction, symbolic clinical reasoning, and retinal-layer spatial information.
Methods: Spectral-domain OCT B-scans were retrospectively collected and classified into ten categories: dry and wet age-related macular degeneration, central serous chorioretinopathy, myopic chorioretinopathy, epiretinal membrane, pseudomacular hole, lamellar macular hole, full-thickness macular hole, diabetic retinopathy, and normal retina. The model combined a CNN backbone with SegFormer-derived retinal-layer maps and mask-guided attention to estimate continuous OCT sign probabilities, which were propagated through expert-defined symbolic rules. Performance was evaluated using multilabel precision, recall, F1-score, confusion matrices, and receiver operating characteristic analysis. Inference was also performed on 402 OCT images from pathologies outside the target taxonomy.
Results: Micro-average precision, recall, and F1-score were 0.91, 0.81, and 0.86, respectively; weighted-average values were 0.91, 0.81, and 0.85, and macro-average values were 0.78, 0.71, and 0.74. The micro-average AUC was 0.98. None of the 402 out-of-taxonomy pathological OCT images received a positive Normal-class prediction at the predefined 0.5 threshold.
Conclusions: The spatially grounded neurosymbolic framework provided interpretable multilabel OCT classification and showed conservative behavior on pathological images outside the modeled taxonomy. This should not be interpreted as diagnostic recognition of unseen diseases.
Translational Relevance: The framework may support transparent, sign-based, and anatomically grounded AI-assisted OCT interpretation.
Related
- Explainable foundation model for dementia screening and risk stratification using retinal fundus images
- An Explainable Disease-Aware Intelligent Histopathological Representation Learning Framework for Generalizable Breast Cancer Classification
- Multimodal fusion of SpO₂ time series and clinical data for explainable classification of obstructive sleep apnea severity
- CERVEX: A Foundation-Model Framework With Built-In Explainable AI for Automated Cervical Cytology Classification From Pap Smear Images
- A multi task deep learning framework for automated health condition prediction from retinal fundus images using hybrid attention and explainable AI
BibTeX
@article{inferrera2026spatially,
title = {{Spatially Grounded Neurosymbolic AI for Explainable Retinal Disease Classification From OCT Images}},
author = {Leandro Inferrera and Alessandro Biscontin and Miloš Ajčević and Agostino Accardo and Alessandro Drigo and Daniele Tognetto and Aleksandar Miladinović},
journal = {Translational Vision Science \& Technology},
year = {2026},
month = oct,
doi = {10.1167/tvst.15.10.36},
url = {https://doi.org/10.1167/tvst.15.10.36},
note = {CC BY-NC-ND 4.0},
}
RIS
TY - JOUR
TI - Spatially Grounded Neurosymbolic AI for Explainable Retinal Disease Classification From OCT Images
AU - Leandro Inferrera
AU - Alessandro Biscontin
AU - Miloš Ajčević
AU - Agostino Accardo
AU - Alessandro Drigo
AU - Daniele Tognetto
AU - Aleksandar Miladinović
PY - 2026
DA - 2026/10/23
JO - Translational Vision Science & Technology
DO - 10.1167/tvst.15.10.36
UR - https://doi.org/10.1167/tvst.15.10.36
AB - Purpose: To develop and evaluate a spatially grounded neurosymbolic AI framework for explainable multilabel retinal disease classification from optical coherence tomography (OCT) images, integrating convolutional neural network (CNN)–based retinal sign extraction, symbolic clinical reasoning, and retinal-layer spatial information. Methods: Spectral-domain OCT B-scans were retrospectively collected and classified into ten categories: dry and wet age-related macular degeneration, central serous chorioretinopathy, myopic chorioretinopathy, epiretinal membrane, pseudomacular hole, lamellar macular hole, full-thickness macular hole, diabetic retinopathy, and normal retina. The model combined a CNN backbone with SegFormer-derived retinal-layer maps and mask-guided attention to estimate continuous OCT sign probabilities, which were propagated through expert-defined symbolic rules. Performance was evaluated using multilabel precision, recall, F1-score, confusion matrices, and receiver operating characteristic analysis. Inference was also performed on 402 OCT images from pathologies outside the target taxonomy. Results: Micro-average precision, recall, and F1-score were 0.91, 0.81, and 0.86, respectively; weighted-average values were 0.91, 0.81, and 0.85, and macro-average values were 0.78, 0.71, and 0.74. The micro-average AUC was 0.98. None of the 402 out-of-taxonomy pathological OCT images received a positive Normal-class prediction at the predefined 0.5 threshold. Conclusions: The spatially grounded neurosymbolic framework provided interpretable multilabel OCT classification and showed conservative behavior on pathological images outside the modeled taxonomy. This should not be interpreted as diagnostic recognition of unseen diseases. Translational Relevance: The framework may support transparent, sign-based, and anatomically grounded AI-assisted OCT interpretation.
SN - 2164-2591
ER -