The Listening Effort Profile of Eye Movements: Easy, Difficult, and Impossible Speech Comprehension
- 1Rotman Research Institute
Abstract
Speech comprehension in noisy environments often requires cognitive effort, but listeners may disengage when comprehension becomes impossible. Eye movements have recently emerged as a promising new measure of listening effort, but it remains unclear whether eye movements are sensitive to the full effort profile across easy, difficult, and impossible speech comprehension. Across four experiments, participants listened to sentences at easy, difficult, and impossible levels of multi-talker background babble while pupil size and eye movements were recorded. Pupil size generally followed the expected inverted u-shaped effort profile: low for easy-to-understand speech, maximal for difficult but still intelligible speech and lower again for impossible-to-understand speech, although this pattern partly reflected sustained, condition-specific differences and not only sentence-evoked responses. Gaze dispersion - measuring the spread of eye movements - decreased specifically during the sentence-listening period for difficult relative to easy and impossible speech, indicating reduced eye movements during active, effortful listening. However, gaze dispersion was also lower, but less specific to the sentence-listening period, during impossible compared to easy listening, especially in non-baseline-corrected analyses, suggesting that reduced eye movements do not index listening effort uniquely. Instead, eye movements appear to reflect both attentional engagement during difficult listening and disengagement or inward attention when meaningful listening is no longer possible. These findings indicate that pupil size and eye movements provide complementary indices of listening-related cognition, and highlight the integration of listening, cognition, and motor systems.
Related
- Eye Movements Reflect Listening Effort and Visualizable Speech
- Auditory Brainstem Encoding of Speech-in-Noise Predicts Word Identification, Narrative Comprehension, and Subjective Listening Effort in a Selective Attention Task
- Keeping both lungs open during open-lung surgery: an impossible challenge?
- Reactions to Perceiving Tangible vs Virtual Impossible objects: Investigating Dimensions of Visual Reality
- Beta bursts carry a graded signal of semantic updating during naturalistic narrative comprehension
BibTeX
@misc{herrmann2026listening,
title = {{The Listening Effort Profile of Eye Movements: Easy, Difficult, and Impossible Speech Comprehension}},
author = {B. Herrmann and L. K. Fink and P. R. Pandey and I. Johnsrude and J. D. Ryan},
howpublished = {bioRxiv},
year = {2026},
month = jun,
doi = {10.64898/2026.06.30.735702},
url = {https://www.biorxiv.org/content/10.64898/2026.06.30.735702v2},
note = {CC BY-NC-ND},
}
RIS
TY - UNPB
TI - The Listening Effort Profile of Eye Movements: Easy, Difficult, and Impossible Speech Comprehension
AU - B. Herrmann
AU - L. K. Fink
AU - P. R. Pandey
AU - I. Johnsrude
AU - J. D. Ryan
PY - 2026
DA - 2026/06/30
PB - bioRxiv
DO - 10.64898/2026.06.30.735702
UR - https://www.biorxiv.org/content/10.64898/2026.06.30.735702v2
AB - Speech comprehension in noisy environments often requires cognitive effort, but listeners may disengage when comprehension becomes impossible. Eye movements have recently emerged as a promising new measure of listening effort, but it remains unclear whether eye movements are sensitive to the full effort profile across easy, difficult, and impossible speech comprehension. Across four experiments, participants listened to sentences at easy, difficult, and impossible levels of multi-talker background babble while pupil size and eye movements were recorded. Pupil size generally followed the expected inverted u-shaped effort profile: low for easy-to-understand speech, maximal for difficult but still intelligible speech and lower again for impossible-to-understand speech, although this pattern partly reflected sustained, condition-specific differences and not only sentence-evoked responses. Gaze dispersion - measuring the spread of eye movements - decreased specifically during the sentence-listening period for difficult relative to easy and impossible speech, indicating reduced eye movements during active, effortful listening. However, gaze dispersion was also lower, but less specific to the sentence-listening period, during impossible compared to easy listening, especially in non-baseline-corrected analyses, suggesting that reduced eye movements do not index listening effort uniquely. Instead, eye movements appear to reflect both attentional engagement during difficult listening and disengagement or inward attention when meaningful listening is no longer possible. These findings indicate that pupil size and eye movements provide complementary indices of listening-related cognition, and highlight the integration of listening, cognition, and motor systems.
ER -