Impact of visual mouth image presentation on speech perception in noise in normal hearing subjects and cochlear implant users
- 1Audiological Acoustics, Department of Otorhinolaryngology, University Hospital, Goethe University Frankfurt, Frankfurt am Main, Germany
- 2Department of Otorhinolaryngology, University Hospital, Goethe University Frankfurt, Frankfurt am Main, Germany
Abstract
This study investigated the impact of visual speech cues on speech perception in noise and subjective listening effort in cochlear implant (CI) users compared with normal-hearing (NH) individuals. Furthermore, the study compared visual information presented either by a computer-generated avatar or by video recordings of a real speaker. Thirteen NH participants and twelve bilateral CI users completed the Oldenburg Sentence Test (OLSA) in six conditions: auditory‑only, visual‑only, and audiovisual presentations using either video recordings (female speaker) or a computer‑animated avatar (male speaker). Speech reception thresholds (SRTs) in noise and subjective listening effort (LE) were measured. Visual‑only lipreading performance and self‑assessed lipreading skills were also recorded. Video‑based audiovisual presentation significantly improved speech perception compared with audio‑only presentation (NH: 1.6 dB; CI: 3.5 dB). CI users demonstrated substantially higher lipreading scores than NH participants (51% vs. 28%), and lipreading performance strongly correlated with self‑reported ability. Despite SRT improvements, audiovisual presentation yielded only marginal reductions in listening effort for CI users and none for NH participants. In contrast, the computer‑animated avatar provided no measurable audiovisual benefit for speech perception or listening effort in either group. Real‑speaker video recordings considerably enhance audiovisual speech perception in both NH individuals and CI users, particularly benefiting CI listeners. However, reductions in listening effort were minimal, underscoring the dissociation between speech perception and perceived listening effort. Incorporating audiovisual measures may improve ecological validity in clinical assessment of CI outcomes.
Related
- The Association of Intra-Operative Steroid Administration on Hearing Threshold and Speech Perception Outcomes in Adult Cochlear Implant Recipients: A Retrospective Cohort Study.
- Piano training designed for cochlear implant users improves speech-on-speech perception
- Spectro-temporal modulation sensitivity prospectively predicts speech-in-noise recognition in cochlear implant users
- The Role of Cochlear Anatomy in Hearing Preservation After Cochlear Implantation in Adults: A Systematic Review
- Long-Term Preservation of High-Frequency Hearing After Cochlear Implantation in a Child with Substantial Residual Hearing: A Case Report
BibTeX
@article{schneider2026impact,
title = {{Impact of visual mouth image presentation on speech perception in noise in normal hearing subjects and cochlear implant users}},
author = {Anna Maria Schneider and Timo Stöver and Tobias Weissgerber},
journal = {PLOS One},
year = {2026},
month = sep,
doi = {10.1371/journal.pone.0357983},
url = {https://doi.org/10.1371/journal.pone.0357983},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - Impact of visual mouth image presentation on speech perception in noise in normal hearing subjects and cochlear implant users
AU - Anna Maria Schneider
AU - Timo Stöver
AU - Tobias Weissgerber
PY - 2026
DA - 2026/09/11
JO - PLOS One
DO - 10.1371/journal.pone.0357983
UR - https://doi.org/10.1371/journal.pone.0357983
AB - This study investigated the impact of visual speech cues on speech perception in noise and subjective listening effort in cochlear implant (CI) users compared with normal-hearing (NH) individuals. Furthermore, the study compared visual information presented either by a computer-generated avatar or by video recordings of a real speaker. Thirteen NH participants and twelve bilateral CI users completed the Oldenburg Sentence Test (OLSA) in six conditions: auditory‑only, visual‑only, and audiovisual presentations using either video recordings (female speaker) or a computer‑animated avatar (male speaker). Speech reception thresholds (SRTs) in noise and subjective listening effort (LE) were measured. Visual‑only lipreading performance and self‑assessed lipreading skills were also recorded. Video‑based audiovisual presentation significantly improved speech perception compared with audio‑only presentation (NH: 1.6 dB; CI: 3.5 dB). CI users demonstrated substantially higher lipreading scores than NH participants (51% vs. 28%), and lipreading performance strongly correlated with self‑reported ability. Despite SRT improvements, audiovisual presentation yielded only marginal reductions in listening effort for CI users and none for NH participants. In contrast, the computer‑animated avatar provided no measurable audiovisual benefit for speech perception or listening effort in either group. Real‑speaker video recordings considerably enhance audiovisual speech perception in both NH individuals and CI users, particularly benefiting CI listeners. However, reductions in listening effort were minimal, underscoring the dissociation between speech perception and perceived listening effort. Incorporating audiovisual measures may improve ecological validity in clinical assessment of CI outcomes.
SN - 1932-6203
ER -