Perceptual integration of multisensory haptic, visual, and auditory feedback for roughness discrimination in augmented reality
- 1Aix-Marseille Univ - CNRS
Abstract
Understanding how our different senses interact to shape our perception is essential to design realistic and immersive virtual and augmented reality (VR/AR) experiences. The present study investigated how roughness perception can be modulated through haptic, visual, and auditory cues in AR using a vibrotactile wristband. Participants compared virtual textures varying in vibration frequency/amplitude, visual grain size, and friction sound. Results revealed strong linear relationships between stimulus parameters and perceived roughness, with haptic frequency and visual cues driving the highest discrimination performance. Adding non-informative sensory feedback reduced perceptual sensitivity, acting as noise. Individual differences emerged: participants who rated haptic as the easiest modality showed greater sensitivity to haptic variations, while visual-reliant participants performed better with visual cues. We conclude that roughness in AR can be systematically manipulated, but is vulnerable to perceptual interference from irrelevant inputs, where our work provides actionable insights for implementing optimized and adaptive AR/VR interfaces.
Related
- Multisensory perceptual decision-making persists as alertness fades, even in the absence of an overt response
- Distinct patterns of multisensory integration underly the expression of flavor preferences and aversions in rats
- The human hippocampus supports auditory coding and multisensory integration
- Advancing specific local wine identification through integration of ICP-MS mineral wine profiles and Machine Learning: A case study on discrimination among the ten Beaujolais crus
- Symbolic categorization of novel multisensory stimuli in the human brain
BibTeX
@misc{bonnet2026perceptual,
title = {{Perceptual integration of multisensory haptic, visual, and auditory feedback for roughness discrimination in augmented reality}},
author = {S. Bonnet and R. Ericsson and I. Zhurakovskaia and H. Daumas and R. Ackerley},
howpublished = {bioRxiv},
year = {2026},
month = sep,
doi = {10.64898/2026.09.09.748749},
url = {https://www.biorxiv.org/content/10.64898/2026.09.09.748749v1},
note = {CC BY-ND},
}
RIS
TY - UNPB
TI - Perceptual integration of multisensory haptic, visual, and auditory feedback for roughness discrimination in augmented reality
AU - S. Bonnet
AU - R. Ericsson
AU - I. Zhurakovskaia
AU - H. Daumas
AU - R. Ackerley
PY - 2026
DA - 2026/09/09
PB - bioRxiv
DO - 10.64898/2026.09.09.748749
UR - https://www.biorxiv.org/content/10.64898/2026.09.09.748749v1
AB - Understanding how our different senses interact to shape our perception is essential to design realistic and immersive virtual and augmented reality (VR/AR) experiences. The present study investigated how roughness perception can be modulated through haptic, visual, and auditory cues in AR using a vibrotactile wristband. Participants compared virtual textures varying in vibration frequency/amplitude, visual grain size, and friction sound. Results revealed strong linear relationships between stimulus parameters and perceived roughness, with haptic frequency and visual cues driving the highest discrimination performance. Adding non-informative sensory feedback reduced perceptual sensitivity, acting as noise. Individual differences emerged: participants who rated haptic as the easiest modality showed greater sensitivity to haptic variations, while visual-reliant participants performed better with visual cues. We conclude that roughness in AR can be systematically manipulated, but is vulnerable to perceptual interference from irrelevant inputs, where our work provides actionable insights for implementing optimized and adaptive AR/VR interfaces.
ER -