A Novel Method for Synchronized Rhythmic Production of Finger Movements and the Effects of Auditory Stimuli and Feedback
Abstract
Manual dexterity relies on accurate and timely coordinated finger movements. Rhythmic fingermovement training can support motor practice, but solutions that combine precise timing with synchronized speech or music feedback remain scarce. We developed Rhythm Karaoke, a rhythmic finger-tapping platform that synchronizes auditory stimuli with finger taps recorded by a manual dexterity device. The platform provides adaptive sound synthesis, multiple stimulus types (notes vs. speech; melodic vs. monotone), real-time auditory feedback, and tapping-error quantification.
To validate the method, we tested whether melodic and semantic content (speech) improve rhythmic precision relative to monotone non-semantic notes, and whether auditory feedback alters performance, motivation, and preference. Healthy participants (n=30) reproduced rhythmic sequences from three French songs in a within-subject design crossing Melody (melodic / monotone), Semantic (speech / notes), and Feedback (present / absent). Tapping error was defined as the average absolute difference between expected and observed proportional inter-tap intervals, expressed as a percentage of song duration. Subjective experience was assessed with the Intrinsic Motivation Inventory. Test-retest reliability was evaluated in a separate group of healthy participants (N=20) for the easiest song in the melodic-note and melodic-speech conditions.
Tapping error differed significantly across songs. ANOVA showed significant effects of Melody and Semantic content and a Melody × Semantic interaction: melody improved performance only for note sequences, and a significant Song × Melody × Semantic interaction showed that the size of the melodic benefit depended on the song. Auditory feedback showed a significant Semantic × Feedback interaction: it tended to reduce tapping error for notes (non-significant after Bonferroni correction) but significantly increased error for speech. Participants preferred melodic conditions, reporting lower perceived tension and higher interest and satisfaction. Reliability was higher for melodic-note than melodic-speech conditions, with excellent test-retest reliability for melodicnote with auditory feedback. These results indicate that melody and semantic content can improve rhythmic precision and engagement, and they support the potential of Rhythm Karaoke for manual dexterity training and neurorehabilitation.
Related
- A touch that lingers: synchronized patting strengthens neural tracking of auditory rhythm in newborns
- Perceptual integration of multisensory haptic, visual, and auditory feedback for roughness discrimination in augmented reality
- Comparison of Body Condition, Milk Production and Animal Movements Between Sopravissana and Comisana Sheep: An Approach to Evaluating Breed Suitability for Sustainable Farming in Central Italy.
- Speed-driven transitions between discrete and rhythmic dynamics in walking revealed by kinematic smoothness and muscle synergies
- Universality Meets Cultural Nuances: Affective Responses to Rhythmic and Harmonic Complexity Across Cultures
BibTeX
@article{arslan2026novel,
title = {{A Novel Method for Synchronized Rhythmic Production of Finger Movements and the Effects of Auditory Stimuli and Feedback}},
author = {Paul-Peter Arslan and Xiao Xiao and Påvel Lindberg},
journal = {Scientific Reports},
year = {2026},
month = sep,
doi = {10.1038/s41598-026-68395-9},
url = {https://inserm.hal.science/inserm-05758266v1},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - A Novel Method for Synchronized Rhythmic Production of Finger Movements and the Effects of Auditory Stimuli and Feedback
AU - Paul-Peter Arslan
AU - Xiao Xiao
AU - Påvel Lindberg
PY - 2026
DA - 2026/09/01
JO - Scientific Reports
DO - 10.1038/s41598-026-68395-9
UR - https://inserm.hal.science/inserm-05758266v1
AB - Manual dexterity relies on accurate and timely coordinated finger movements. Rhythmic fingermovement training can support motor practice, but solutions that combine precise timing with synchronized speech or music feedback remain scarce. We developed Rhythm Karaoke, a rhythmic finger-tapping platform that synchronizes auditory stimuli with finger taps recorded by a manual dexterity device. The platform provides adaptive sound synthesis, multiple stimulus types (notes vs. speech; melodic vs. monotone), real-time auditory feedback, and tapping-error quantification. To validate the method, we tested whether melodic and semantic content (speech) improve rhythmic precision relative to monotone non-semantic notes, and whether auditory feedback alters performance, motivation, and preference. Healthy participants (n=30) reproduced rhythmic sequences from three French songs in a within-subject design crossing Melody (melodic / monotone), Semantic (speech / notes), and Feedback (present / absent). Tapping error was defined as the average absolute difference between expected and observed proportional inter-tap intervals, expressed as a percentage of song duration. Subjective experience was assessed with the Intrinsic Motivation Inventory. Test-retest reliability was evaluated in a separate group of healthy participants (N=20) for the easiest song in the melodic-note and melodic-speech conditions. Tapping error differed significantly across songs. ANOVA showed significant effects of Melody and Semantic content and a Melody × Semantic interaction: melody improved performance only for note sequences, and a significant Song × Melody × Semantic interaction showed that the size of the melodic benefit depended on the song. Auditory feedback showed a significant Semantic × Feedback interaction: it tended to reduce tapping error for notes (non-significant after Bonferroni correction) but significantly increased error for speech. Participants preferred melodic conditions, reporting lower perceived tension and higher interest and satisfaction. Reliability was higher for melodic-note than melodic-speech conditions, with excellent test-retest reliability for melodicnote with auditory feedback. These results indicate that melody and semantic content can improve rhythmic precision and engagement, and they support the potential of Rhythm Karaoke for manual dexterity training and neurorehabilitation.
SN - 2045-2322
ER -