Img2EEG: A Scalable and Interpretable Encoding Framework for Simulating Human EEG Responses to Visual Inputs
- 1Massachusetts Institute of Technology
Abstract
Understanding how visual information processing unfolds over time requires models that not only predict neural responses but also expose the representations that support them and generalize beyond sampled stimulus spaces. Here we introduce Img2EEG, a participant-specific image-to-EEG encoding framework that integrates hierarchical visual and semantic representations to generate temporally resolved multichannel EEG responses. Trained on THINGS EEG2, Img2EEG generalized to unseen images while preserving stimulus-specific and participant-specific response structure. Controlled perturbations of internal representations and visual inputs revealed distinct temporally structured contributions of visual and semantic information, and in silico experiments reproduced classic human neural responses, such as the face-sensitive N170, while enabling targeted representational interventions. Scaling Img2EEG to 1.28 million ImageNet images produced over 12 million synthetic EEG responses that supported cross-dataset visual reconstruction and improved the behavioral alignment of an artificial vision model. Img2EEG provides an interpretable and scalable framework for experimentally manipulable modeling of visual neural dynamics.
Related
- Uncertainties in simulating wheat growth responses to waterlogging
- SpCAST enables scalable and interpretable integration of single-cell RNA sequencing and single-cell-resolved spatial transcriptomics
- BIRDNet: Mining and Encoding Boolean Implication Knowledge Graphs as Interpretable Deep Neural Networks
- Interpretable embeddings of speech explain and enhance the brain encoding performance of audio models
- Pain Matters: Nociceptive signaling drives neural encoding of inflammatory responses
BibTeX
@misc{lu2026img2eeg,
title = {{Img2EEG: A Scalable and Interpretable Encoding Framework for Simulating Human EEG Responses to Visual Inputs}},
author = {Z. Lu and J. D. Golomb},
howpublished = {bioRxiv},
year = {2026},
month = sep,
doi = {10.64898/2026.09.16.751610},
url = {https://www.biorxiv.org/content/10.64898/2026.09.16.751610v1},
note = {CC BY-NC-ND},
}
RIS
TY - UNPB
TI - Img2EEG: A Scalable and Interpretable Encoding Framework for Simulating Human EEG Responses to Visual Inputs
AU - Z. Lu
AU - J. D. Golomb
PY - 2026
DA - 2026/09/16
PB - bioRxiv
DO - 10.64898/2026.09.16.751610
UR - https://www.biorxiv.org/content/10.64898/2026.09.16.751610v1
AB - Understanding how visual information processing unfolds over time requires models that not only predict neural responses but also expose the representations that support them and generalize beyond sampled stimulus spaces. Here we introduce Img2EEG, a participant-specific image-to-EEG encoding framework that integrates hierarchical visual and semantic representations to generate temporally resolved multichannel EEG responses. Trained on THINGS EEG2, Img2EEG generalized to unseen images while preserving stimulus-specific and participant-specific response structure. Controlled perturbations of internal representations and visual inputs revealed distinct temporally structured contributions of visual and semantic information, and in silico experiments reproduced classic human neural responses, such as the face-sensitive N170, while enabling targeted representational interventions. Scaling Img2EEG to 1.28 million ImageNet images produced over 12 million synthetic EEG responses that supported cross-dataset visual reconstruction and improved the behavioral alignment of an artificial vision model. Img2EEG provides an interpretable and scalable framework for experimentally manipulable modeling of visual neural dynamics.
ER -