{ "abstract": "Background: Sign Language (SL) is essential for Deaf communities, yet limited SL proficiency sustains communication barriers in education and services. We propose an interactive tutoring system for Ecuadorian Sign Language (EcSL) that combines real-time, vision-based gesture assessment with an embodied “reward” delivered by a robotic arm, using fruit vocabulary as an initial learning domain. Methods: We will conduct a two-arm randomized controlled experimental design, pretest–posttest control-group study with individual random assignment. About 70 university students without formal EcSL training will learn EcSL fruit signs through video and sign recognition feedback module. The system uses a webcam, MediaPipe landmark extraction, and a landmark-based fusion classifier that combines a local bidirectional LSTM with a transferred ST-GCN motion encoder; modules communicate via Robot Operating System (ROS). Outcomes. A total of six dependent variables will be assessed in both the experimental and control groups: (a) handshape, (b) palm orientation, (c) location, (d) movement, (e) non-manual signals and expressions, and (f) global coordination. Analyses will use descriptive statistics, reliability checks when applicable, and a mixed repeated-measures MANOVA. Discussion: By coupling immediate feedback with embodied reinforcement, delivered through a robotic arm, the platform aims to support early sign accuracy and provide a motivating practice environment for learners. The robotic arm responds to participants’ performance with physical rewards, thereby reinforcing correct execution through tangible, real-time stimuli. Results will guide improvements in robustness and inform extensions to broader vocabularies and deployment in educational contexts.", "abstract_shown": true, "affiliations": [ "Facultad de Ingenierías, Centro de Investigación en Mecatrónica y Sistemas Interactivos (MIST), Universidad Tecnológica Indoamérica, Quito, Ecuador.", "Centro de Investigación de Ciencias Humanas y de la Educación (CICHE), Universidad Tecnológica Indoamérica, Quito, Ecuador.", "Facultad de Salud y Bienestar, Carrera de Psicología, Pontificia Universidad Católica del Ecuador, Quito, Ecuador.", "Centro de Traducciones de la PUCE, Pontificia Universidad Católica del Ecuador, Quito, Ecuador." ], "article_type": "Study Protocol", "arxiv": null, "author_total": 6, "authors": [ { "affs": [ 0 ], "name": "Mireya Zapata", "orcid": "0000-0003-3382-2724" }, { "affs": [ 0 ], "name": "Andrès Rubio Proaño", "orcid": "0000-0003-1270-9140" }, { "affs": [ 1 ], "name": "Hugo Arias-Flores", "orcid": "0000-0003-0106-6661" }, { "affs": [ 0 ], "name": "Alejandro Camino" }, { "affs": [ 2 ], "name": "Carlos Ramos-Galarza" }, { "affs": [ 3 ], "name": "Jorge Banet" } ], "bibtex": "https://research.draconitic.com/paper/b78cbztdkz4p2.bib", "cited_by": 0, "doi": "10.1371/journal.pone.0345934", "fulltext_url": "https://europepmc.org/articles/PMC13716198", "id": "b78cbztdkz4p2", "issns": [ "1932-6203" ], "landing_url": "https://doi.org/10.1371/journal.pone.0345934", "language": "eng", "licence": "CC-BY", "licence_label": "CC BY", "licence_source": "article", "licence_url": "https://creativecommons.org/licenses/by/4.0/", "metadata_licence": null, "native_subjects": [ [ "heading", "Anatomy" ], [ "heading", "Arms" ], [ "heading", "Behavior" ], [ "heading", "Biology and Life Sciences" ], [ "heading", "Biomechanics" ], [ "heading", "Body Limbs" ], [ "heading", "Cognitive Psychology" ], [ "heading", "Cognitive Science" ], [ "heading", "Deafness" ], [ "heading", "Engineering and Technology" ], [ "heading", "Eukaryota" ], [ "heading", "Fruits" ], [ "heading", "Hands" ], [ "heading", "Hearing Disorders" ], [ "heading", "Human Learning" ], [ "heading", "Languages" ], [ "heading", "Learning" ], [ "heading", "Learning and Memory" ], [ "heading", "Linguistics" ], [ "heading", "Mechanical Engineering" ], [ "heading", "Medicine and Health Sciences" ], [ "heading", "Muscle Physiology" ], [ "heading", "Musculoskeletal Mechanics" ], [ "heading", "Neuroscience" ], [ "heading", "Nonverbal Communication" ], [ "heading", "Organisms" ], [ "heading", "Otology" ], [ "heading", "Otorhinolaryngology" ], [ "heading", "Physiology" ], [ "heading", "Plants" ], [ "heading", "Psychology" ], [ "heading", "Robotics" ], [ "heading", "Robots" ], [ "heading", "Sign Language" ], [ "heading", "Social Sciences" ], [ "heading", "Study Protocol" ], [ "openalex", "1709|Hand Gesture Recognition Systems" ], [ "plos", "/Biology and life sciences/Anatomy/Body limbs/Arms/Hands" ], [ "plos", "/Biology and life sciences/Biomechanics/Musculoskeletal mechanics" ], [ "plos", "/Biology and life sciences/Neuroscience/Cognitive science/Cognitive psychology/Learning/Human learning" ], [ "plos", "/Biology and life sciences/Neuroscience/Learning and memory/Learning/Human learning" ], [ "plos", "/Biology and life sciences/Organisms/Eukaryota/Plants/Fruits" ], [ "plos", "/Biology and life sciences/Physiology/Muscle physiology/Musculoskeletal mechanics" ], [ "plos", "/Biology and life sciences/Psychology/Behavior/Nonverbal communication/Sign language" ], [ "plos", "/Biology and life sciences/Psychology/Cognitive psychology/Learning/Human learning" ], [ "plos", "/Engineering and technology/Mechanical engineering/Robotics" ], [ "plos", "/Engineering and technology/Mechanical engineering/Robotics/Robots" ], [ "plos", "/Medicine and health sciences/Anatomy/Body limbs/Arms/Hands" ], [ "plos", "/Medicine and health sciences/Otorhinolaryngology/Otology/Hearing disorders/Deafness" ], [ "plos", "/Social sciences/Linguistics/Languages/Sign language" ], [ "plos", "/Social sciences/Psychology/Behavior/Nonverbal communication/Sign language" ], [ "plos", "/Social sciences/Psychology/Cognitive psychology/Learning/Human learning" ] ], "openalex": "W7224097060", "pdf_url": "https://europepmc.org/articles/PMC13716198?pdf=render", "pmcid": "PMC13716198", "pmid": "42949881", "published": "2026-10-28", "publisher": "Public Library of Science", "ris": "https://research.draconitic.com/paper/b78cbztdkz4p2.ris", "sources": [ { "first_seen": "2026-10-30T12:17:17Z", "native_id": "10.1371/journal.pone.0345934", "source": "plos", "url": "https://doi.org/10.1371/journal.pone.0345934" }, { "first_seen": "2026-10-31T00:20:33Z", "native_id": "MED:42949881", "source": "europepmc", "url": "https://europepmc.org/article/MED/42949881" }, { "first_seen": "2026-11-01T12:23:14Z", "native_id": "PMC13716198", "source": "pmc", "url": "https://doi.org/10.1371/journal.pone.0345934" } ], "subjects": [ { "field": "biology", "origin": "plos:neuroscience", "subfield": "neuroscience" }, { "field": "medicine", "origin": "plos:anatomy", "subfield": "physiology" } ], "title": "Sign language teaching protocol with an interactive robotic arm and real-time vision feedback", "title_text": "Sign language teaching protocol with an interactive robotic arm and real-time vision feedback", "type": "peer-reviewed", "updated_at": "2026-11-01T12:23:14Z", "url": "https://research.draconitic.com/paper/b78cbztdkz4p2", "venue": "PLOS One", "versions": [] }