Development and Evaluation of a Realistic Audio-Visual Multi-Talker Speech Comprehension Test
- 1Department of Linguistics, Macquarie University, Sydney, Australia
- 2Ecological Hearing Outcomes (ECHO) Laboratory, Macquarie University, Sydney, Australia
- 3Sonova AG, Research & Development, Stäfa, Switzerland
Abstract
Current speech comprehension assessments do not provide a reliable measure of listeners’ real-life speech comprehension ability, as they fail to capture the complexity and dynamic nature of real-world communicative scenarios. To better align laboratory assessment with real-world listening demands, we developed a new speech comprehension test using audio-visual recordings of spontaneous conversations between two talkers. The conversations were combined with babble noise at three different signal-to-noise ratios (SNRs) to vary task difficulty (Quiet, 0dB, and -5dB). Speech comprehension was assessed using a word monitoring paradigm, in which listeners were given a word category and responded to target words related to that category by pressing a hand-held button. Outcome measures included self-rated listening effort, hit rate, response time (RT), and head turn behavior. Thirty adults with normal hearing were tested. With decreasing SNR, self-reported listening effort increased, hit rate decreased, and RT increased. Participants predominantly oriented toward the active talker, with visual localization achieved through a combination of head and eye movements. Dynamic analyses around conversational floor transfers revealed that, listeners oriented earlier and more consistently toward the upcoming talker in more challenging conditions. None of the behavioral measures were significantly associated with listening effort ratings after accounting for SNR effects. Overall, our results demonstrate that the proposed test provides a sensitive measure of real-world speech comprehension and holds promise for assessing the impact of hearing loss and evaluating hearing device benefit in ecologically valid settings.
Related
- DigiFish: A flexible open-source tool for animating realistic virtual fish and reconstructing visual fields from tracking data
- Mathematical model for visual cortical development based on molecular mechanisms underlying the generation and elimination of dendritic spines
- Development and preliminary validation of an omp25-based RPA-CRISPR/Cas12a visual assay for rapid screening of brucellosis-associated Brucella DNA
- The ViRA-L (Visual Recognition Assessment-Leuven): Development, Validation, and Age Stratified Normative Characterization of a Multi-Category Visual Recognition Battery
- The development of coarse and fine feature tuning in infant visual cortex
BibTeX
@article{guo2026development,
title = {{Development and Evaluation of a Realistic Audio-Visual Multi-Talker Speech Comprehension Test}},
author = {Xinyu Guo and Rebecca Holt and Kelly Miles and Ronny Kurniawan Ibrahim and Stefan Raufer and Peter Derleth and Joerg M. Buchholz},
journal = {Trends in Hearing},
year = {2026},
month = sep,
doi = {10.1177/23312165261489985},
url = {https://doi.org/10.1177/23312165261489985},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - Development and Evaluation of a Realistic Audio-Visual Multi-Talker Speech Comprehension Test
AU - Xinyu Guo
AU - Rebecca Holt
AU - Kelly Miles
AU - Ronny Kurniawan Ibrahim
AU - Stefan Raufer
AU - Peter Derleth
AU - Joerg M. Buchholz
PY - 2026
DA - 2026/09/17
JO - Trends in Hearing
DO - 10.1177/23312165261489985
UR - https://doi.org/10.1177/23312165261489985
AB - Current speech comprehension assessments do not provide a reliable measure of listeners’ real-life speech comprehension ability, as they fail to capture the complexity and dynamic nature of real-world communicative scenarios. To better align laboratory assessment with real-world listening demands, we developed a new speech comprehension test using audio-visual recordings of spontaneous conversations between two talkers. The conversations were combined with babble noise at three different signal-to-noise ratios (SNRs) to vary task difficulty (Quiet, 0dB, and -5dB). Speech comprehension was assessed using a word monitoring paradigm, in which listeners were given a word category and responded to target words related to that category by pressing a hand-held button. Outcome measures included self-rated listening effort, hit rate, response time (RT), and head turn behavior. Thirty adults with normal hearing were tested. With decreasing SNR, self-reported listening effort increased, hit rate decreased, and RT increased. Participants predominantly oriented toward the active talker, with visual localization achieved through a combination of head and eye movements. Dynamic analyses around conversational floor transfers revealed that, listeners oriented earlier and more consistently toward the upcoming talker in more challenging conditions. None of the behavioral measures were significantly associated with listening effort ratings after accounting for SNR effects. Overall, our results demonstrate that the proposed test provides a sensitive measure of real-world speech comprehension and holds promise for assessing the impact of hearing loss and evaluating hearing device benefit in ecologically valid settings.
SN - 2331-2165
ER -