Semantic ambiguity dissociates the roles of word meaning and co-occurrence statistics in sentence processing
- 1University of Tübingen
Abstract
Next-word prediction is a key component of human language processing, which manifests itself in higher processing costs (longer reading times and enhanced neural responses) to unpredictable words. These costs are captured by large language model (LLM) surprisal, a metric inferred from statistical patterns of word co-occurrence. This makes word co-occurrence statistics a plausible candidate source for human next-word prediction. In contrast, psycholinguistic models posit that human next-word prediction relies on representations of word meaning. To contrast these views, we placed words that carry multiple meanings in contexts that rendered meaning ambiguous (e.g., 'My colleagues portrayed the head': body part or leader). With this, we kept word co-occurrence statistics available for prediction but introduced uncertainty into word meaning, effectively decorrelating these putative drivers of next-word prediction. Across three self-paced reading and magnetoencephalography (MEG) experiments, human processing costs for unpredictable unambiguous words were captured by LLM word surprisal, while ambiguity disrupted this relation. This shows that human next-word prediction is mechanistically linked to ambiguity resolution, diverging from LLM-like statistics-driven prediction specifically under ambiguity. We further found that a shared cortical network supports prediction and ambiguity resolution in parallel. Overall, our findings corroborate a distinctive feature of predictive language processing in humans, namely its reliance on word meaning beyond statistical patterns of word co-occurrence.
Related
- Frequency-specific oscillations track parallel processing of linguistic structural and lexical-semantic information from perception to decision
- When meaning becomes decodable: Linking neural markers of semantic processing and semantic representations
- Assessing the Impact of Language on Visual Threat Detection: cTBS over the anterior temporal lobe impairs semantic processing but not visual threat detection
- Post-Encoding Semantic Processing Produces Systematic Distortions in Episodic Memory
- Occurrence, persistence and pathogenic potential of Bacillus cereus sensu lato strains isolated during processing of two plant-based desserts
BibTeX
@misc{zyryanov2026semantic,
title = {{Semantic ambiguity dissociates the roles of word meaning and co-occurrence statistics in sentence processing}},
author = {A. Zyryanov and V. Pierz and Y. Oganian},
howpublished = {bioRxiv},
year = {2026},
month = may,
doi = {10.64898/2026.05.15.724229},
url = {https://www.biorxiv.org/content/10.64898/2026.05.15.724229v2},
note = {CC BY-NC-ND},
}
RIS
TY - UNPB
TI - Semantic ambiguity dissociates the roles of word meaning and co-occurrence statistics in sentence processing
AU - A. Zyryanov
AU - V. Pierz
AU - Y. Oganian
PY - 2026
DA - 2026/05/15
PB - bioRxiv
DO - 10.64898/2026.05.15.724229
UR - https://www.biorxiv.org/content/10.64898/2026.05.15.724229v2
AB - Next-word prediction is a key component of human language processing, which manifests itself in higher processing costs (longer reading times and enhanced neural responses) to unpredictable words. These costs are captured by large language model (LLM) surprisal, a metric inferred from statistical patterns of word co-occurrence. This makes word co-occurrence statistics a plausible candidate source for human next-word prediction. In contrast, psycholinguistic models posit that human next-word prediction relies on representations of word meaning. To contrast these views, we placed words that carry multiple meanings in contexts that rendered meaning ambiguous (e.g., 'My colleagues portrayed the head': body part or leader). With this, we kept word co-occurrence statistics available for prediction but introduced uncertainty into word meaning, effectively decorrelating these putative drivers of next-word prediction. Across three self-paced reading and magnetoencephalography (MEG) experiments, human processing costs for unpredictable unambiguous words were captured by LLM word surprisal, while ambiguity disrupted this relation. This shows that human next-word prediction is mechanistically linked to ambiguity resolution, diverging from LLM-like statistics-driven prediction specifically under ambiguity. We further found that a shared cortical network supports prediction and ambiguity resolution in parallel. Overall, our findings corroborate a distinctive feature of predictive language processing in humans, namely its reliance on word meaning beyond statistical patterns of word co-occurrence.
ER -