{
  "abstract": "The hippocampus receives convergent input from multiple sensory systems, yet in humans it has been studied almost exclusively through vision. Here we examine how the hippocampus contributes to sensory processing beyond the visual modality and to the multisensory integration of visual information with these other modalities. Participants were exposed to multiple repetitions of short naturalistic movie clips, each presented in four formats: auditory-only, visual-only, congruent audiovisual, and incongruent audiovisual (audio and video from different movies). Using high-resolution fMRI, we measured univariate activation and multivariate representations across the longitudinal axis and subfields of the human hippocampus. Whereas univariate analyses detected only visual responses across hippocampal subregions, with no activation for auditory stimuli and no benefit of congruent stimuli, multivariate analyses revealed robust representations of both auditory and visual scenes. The posterior hippocampus showed enhanced pattern similarity for congruent stimuli relative to unisensory stimuli, especially in the left hemisphere, demonstrating multisensory facilitation. The anterior hippocampus showed crossmodal decoding between auditory and visual versions of the same clip, driven by the right hemisphere, suggesting a more abstract representation. Finally, whole-brain searchlight analyses revealed parallel effects in cortical regions known to support multisensory integration. These findings advance understanding of auditory and multisensory coding in the human hippocampus, revealing specialization and lateralization along its longitudinal axis.\n\nHow does the hippocampus integrate fragmented sights and sounds into a coherent experience? This study reveals auditory and multisensory coding in the human hippocampus, including a functional dissociation along its longitudinal axis, with multisensory facilitation in the posterior and crossmodal generalization in the anterior hippocampus.",
  "abstract_shown": true,
  "affiliations": [
    "Department of Psychology, Yale University, New Haven, Connecticut, United States of America",
    "Wu Tsai Institute, Yale University, New Haven, Connecticut, United States of America",
    "Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States of America"
  ],
  "article_type": "Research Article",
  "arxiv": null,
  "author_total": 4,
  "authors": [
    {
      "affs": [
        0,
        1
      ],
      "name": "Omri Raccah",
      "orcid": "0000-0002-3393-581X"
    },
    {
      "affs": [
        0,
        1
      ],
      "name": "Aryan Agarwal"
    },
    {
      "affs": [
        2
      ],
      "name": "Yannan Zhu"
    },
    {
      "affs": [
        0,
        1
      ],
      "name": "Nicholas B. Turk-Browne"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/dbx933nmbf8pk.bib",
  "cited_by": 2,
  "doi": "10.1371/journal.pbio.3004012",
  "fulltext_url": "https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3004012",
  "id": "dbx933nmbf8pk",
  "issns": [
    "1545-7885",
    "1544-9173"
  ],
  "landing_url": "https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3004012",
  "language": "eng",
  "licence": "CC-BY",
  "licence_label": "CC BY",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "heading",
      "Anatomy"
    ],
    [
      "heading",
      "Attention"
    ],
    [
      "heading",
      "Biology and Life Sciences"
    ],
    [
      "heading",
      "Brain"
    ],
    [
      "heading",
      "Brain Mapping"
    ],
    [
      "heading",
      "Cerebral Cortex"
    ],
    [
      "heading",
      "Cerebral Hemispheres"
    ],
    [
      "heading",
      "Cognition"
    ],
    [
      "heading",
      "Cognitive Psychology"
    ],
    [
      "heading",
      "Cognitive Science"
    ],
    [
      "heading",
      "Diagnostic Medicine"
    ],
    [
      "heading",
      "Diagnostic Radiology"
    ],
    [
      "heading",
      "Functional Magnetic Resonance Imaging"
    ],
    [
      "heading",
      "Hippocampus"
    ],
    [
      "heading",
      "Imaging Techniques"
    ],
    [
      "heading",
      "Learning and Memory"
    ],
    [
      "heading",
      "Left Hemisphere"
    ],
    [
      "heading",
      "Magnetic Resonance Imaging"
    ],
    [
      "heading",
      "Medicine and Health Sciences"
    ],
    [
      "heading",
      "Memory"
    ],
    [
      "heading",
      "Neuroimaging"
    ],
    [
      "heading",
      "Neuroscience"
    ],
    [
      "heading",
      "Perception"
    ],
    [
      "heading",
      "Psychology"
    ],
    [
      "heading",
      "Radiology and Imaging"
    ],
    [
      "heading",
      "Research Article"
    ],
    [
      "heading",
      "Research and Analysis Methods"
    ],
    [
      "heading",
      "Sensory Perception"
    ],
    [
      "heading",
      "Social Sciences"
    ],
    [
      "heading",
      "Temporal Lobe"
    ],
    [
      "heading",
      "Vision"
    ],
    [
      "openalex",
      "3205|Multisensory perception and integration"
    ],
    [
      "plos",
      "/Biology and life sciences/Anatomy/Brain/Cerebral cortex/Temporal lobe"
    ],
    [
      "plos",
      "/Biology and life sciences/Anatomy/Brain/Cerebral hemispheres/Left hemisphere"
    ],
    [
      "plos",
      "/Biology and life sciences/Anatomy/Brain/Hippocampus"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Brain mapping/Functional magnetic resonance imaging"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Cognitive science/Cognition/Memory"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Cognitive science/Cognitive psychology/Attention"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Cognitive science/Cognitive psychology/Perception/Sensory perception"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Cognitive science/Cognitive psychology/Perception/Sensory perception/Vision"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Learning and memory/Memory"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Neuroimaging/Functional magnetic resonance imaging"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Sensory perception"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Sensory perception/Vision"
    ],
    [
      "plos",
      "/Biology and life sciences/Psychology/Cognitive psychology/Attention"
    ],
    [
      "plos",
      "/Biology and life sciences/Psychology/Cognitive psychology/Perception/Sensory perception"
    ],
    [
      "plos",
      "/Biology and life sciences/Psychology/Cognitive psychology/Perception/Sensory perception/Vision"
    ],
    [
      "plos",
      "/Medicine and health sciences/Anatomy/Brain/Cerebral cortex/Temporal lobe"
    ],
    [
      "plos",
      "/Medicine and health sciences/Anatomy/Brain/Cerebral hemispheres/Left hemisphere"
    ],
    [
      "plos",
      "/Medicine and health sciences/Anatomy/Brain/Hippocampus"
    ],
    [
      "plos",
      "/Medicine and health sciences/Diagnostic medicine/Diagnostic radiology/Magnetic resonance imaging/Functional magnetic resonance imaging"
    ],
    [
      "plos",
      "/Medicine and health sciences/Radiology and imaging/Diagnostic radiology/Magnetic resonance imaging/Functional magnetic resonance imaging"
    ],
    [
      "plos",
      "/Research and analysis methods/Imaging techniques/Diagnostic radiology/Magnetic resonance imaging/Functional magnetic resonance imaging"
    ],
    [
      "plos",
      "/Research and analysis methods/Imaging techniques/Neuroimaging/Functional magnetic resonance imaging"
    ],
    [
      "plos",
      "/Social sciences/Psychology/Cognitive psychology/Attention"
    ],
    [
      "plos",
      "/Social sciences/Psychology/Cognitive psychology/Perception/Sensory perception"
    ],
    [
      "plos",
      "/Social sciences/Psychology/Cognitive psychology/Perception/Sensory perception/Vision"
    ]
  ],
  "openalex": "W7133323531",
  "pdf_url": "https://journals.plos.org/plosbiology/article/file?id=10.1371/journal.pbio.3004012&type=printable",
  "pmcid": "PMC13730386",
  "pmid": "42976179",
  "published": "2026-11-01",
  "publisher": "Public Library of Science",
  "ris": "https://research.draconitic.com/paper/dbx933nmbf8pk.ris",
  "sources": [
    {
      "first_seen": "2026-11-04T12:20:43Z",
      "native_id": "10.1371/journal.pbio.3004012",
      "source": "plos",
      "url": "https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3004012"
    },
    {
      "first_seen": "2026-11-04T15:20:46Z",
      "native_id": "PMC:PMC13730386",
      "source": "europepmc",
      "url": "https://europepmc.org/article/PMC/PMC13730386"
    },
    {
      "first_seen": "2026-11-07T12:22:57Z",
      "native_id": "PMC13730386",
      "source": "pmc",
      "url": "https://doi.org/10.1371/journal.pbio.3004012"
    }
  ],
  "subjects": [
    {
      "field": "biology",
      "origin": "plos:neuroscience",
      "subfield": "neuroscience"
    },
    {
      "field": "medicine",
      "origin": "heading:Diagnostic Radiology",
      "subfield": "imaging"
    },
    {
      "field": "medicine",
      "origin": "plos:anatomy",
      "subfield": "physiology"
    }
  ],
  "title": "The human hippocampus supports auditory coding and multisensory integration",
  "title_text": "The human hippocampus supports auditory coding and multisensory integration",
  "type": "peer-reviewed",
  "updated_at": "2026-11-07T12:22:57Z",
  "url": "https://research.draconitic.com/paper/dbx933nmbf8pk",
  "venue": "PLOS Biology",
  "versions": []
}