Meta reinforcement learning for robust quadruped locomotion under joint failures
- 1Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
- 2School of Electrical Engineering, Shandong Huayu University of Technology, Dezhou, China
- 3Department of Naval Architecture and Ocean Engineering, Pusan National University, Busan, South Korea
Abstract
Joint failures can disrupt gait coordination, velocity tracking, and body stability in quadruped robots by reducing the available control authority. This study investigates faults in which joints remain locked at fixed angles and presents Adjudicate Reconfiguration and Evolving Regularization Meta Reinforcement Learning (ARER-MetaRL). The framework combines task inference from context, modular routing tailored to each task through an Adjudicate Reconfiguration (AR) network, and Evolving Gradient Regularization (ER) to support rapid adaptation. Tasks differ in the identities and locking angles of the faulty joints, the number of simultaneous faults, the commanded motion direction, and the terrain. Experiments in NVIDIA Isaac Sim cover all 12 actuated joints, with 0–3 stuck joints during meta-training and severity tests involving up to 6 simultaneously stuck joints. ARER-MetaRL achieves higher Mean Episode Linear Velocity Tracking Reward (MELV) and Mean Episode Roll–Pitch Tracking Reward (MERP) than single-task reinforcement learning, ablated variants, and the evaluated learning and adaptation baselines. Cumulative rewards further demonstrate the benefit of combining the proposed components. In the study of fault severity, ARER-MetaRL achieves MELV/MERP values of 0.86/0.84 with one stuck joint and 0.55/0.54 with six stuck joints, compared with 0.21/0.18 and 0.05/0.03, respectively, for the single-task baseline. These results show improved adaptation across different configurations of locked joints and terrain conditions.
Related
- Robust disturbance-aware actor–critic reinforcement learning for multi-DOF robotic manipulators
- Reln Haploinsufficiency Enhances Fentanyl-Induced Locomotion and Dorsal Striatal Activity Without Affecting Opioid Reinforcement and Relapse-Like Behavior.
- Robust and Quality-of-Life-Aware Treatment Protocols in NSCLC using Deep Reinforcement Learning
- Robust pan-junctional reinforcement preserves the gut epithelial barrier under mechanical stress
- Reliability-based arbitration reveals heterogeneous model-based and model-free reinforcement learning strategies linked to compulsivity and impulsivity
BibTeX
@article{wu2026meta,
title = {{Meta reinforcement learning for robust quadruped locomotion under joint failures}},
author = {Likai Wu and Chee-Onn Chow and Wei Ru Wong and Joon Huang Chuah and Jeevan Kanesan and Meina Zhang},
journal = {PLOS One},
year = {2026},
month = oct,
doi = {10.1371/journal.pone.0361099},
url = {https://doi.org/10.1371/journal.pone.0361099},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - Meta reinforcement learning for robust quadruped locomotion under joint failures
AU - Likai Wu
AU - Chee-Onn Chow
AU - Wei Ru Wong
AU - Joon Huang Chuah
AU - Jeevan Kanesan
AU - Meina Zhang
PY - 2026
DA - 2026/10/16
JO - PLOS One
DO - 10.1371/journal.pone.0361099
UR - https://doi.org/10.1371/journal.pone.0361099
AB - Joint failures can disrupt gait coordination, velocity tracking, and body stability in quadruped robots by reducing the available control authority. This study investigates faults in which joints remain locked at fixed angles and presents Adjudicate Reconfiguration and Evolving Regularization Meta Reinforcement Learning (ARER-MetaRL). The framework combines task inference from context, modular routing tailored to each task through an Adjudicate Reconfiguration (AR) network, and Evolving Gradient Regularization (ER) to support rapid adaptation. Tasks differ in the identities and locking angles of the faulty joints, the number of simultaneous faults, the commanded motion direction, and the terrain. Experiments in NVIDIA Isaac Sim cover all 12 actuated joints, with 0–3 stuck joints during meta-training and severity tests involving up to 6 simultaneously stuck joints. ARER-MetaRL achieves higher Mean Episode Linear Velocity Tracking Reward (MELV) and Mean Episode Roll–Pitch Tracking Reward (MERP) than single-task reinforcement learning, ablated variants, and the evaluated learning and adaptation baselines. Cumulative rewards further demonstrate the benefit of combining the proposed components. In the study of fault severity, ARER-MetaRL achieves MELV/MERP values of 0.86/0.84 with one stuck joint and 0.55/0.54 with six stuck joints, compared with 0.21/0.18 and 0.05/0.03, respectively, for the single-task baseline. These results show improved adaptation across different configurations of locked joints and terrain conditions.
SN - 1932-6203
ER -