{
  "abstract": "Building on recent insights that augmenting reinforcement‐learning policies with disturbance estimates improves robustness and sim-to-real transfer, this paper proposes a disturbance-aware actor–critic RL framework for high‐precision robotic manipulators. We derive the dynamics of manipulators ranging from two to six degrees of freedom and design a nonlinear disturbance observer that provides real-time estimates of lumped uncertainties. Unlike conventional feedforward-only designs, the proposed DACRL framework deeply integrates DOB information into the actor-critic’s learning state, cost function, and update laws to explicitly compensate for unknown dynamics and disturbances. A Lyapunov-based analysis proves that tracking errors, observer errors and neural-network weight errors remain uniformly ultimately bounded. Extensive simulations show that the proposed controller achieves sub-degree tracking errors across multiple DOF cases, with the 2-DOF example achieving steady-state errors below ±0.02 rad (Joint 1) and ±0.05 rad (Joint 2) and delivering faster convergence and smoother torques than conventional RL and DOB baselines. The disturbance-aware controller generalizes across trajectories and payloads, offering improved robustness while retaining learning flexibility. While the current study focuses on performance and robustness, future work could explore the integration of disturbance-observer-based control barrier functions to formally address safety constraints during the learning process. Simulation results suggest that the disturbance-aware controller can improve robustness while retaining learning flexibility. Real-platform validation remains an important direction for future work.",
  "abstract_shown": true,
  "affiliations": [
    "Faculty of Electrical and Electronic Engineering, Hung Yen University of Technology and Education, Vietnam"
  ],
  "article_type": "Research Article",
  "arxiv": null,
  "author_total": 4,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Viet Ngu Nguyen"
    },
    {
      "name": "Thi Minh Tam Le"
    },
    {
      "name": "Duc Hung Pham"
    },
    {
      "name": "Huu Cuong Nguyen"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/dtyxqt4g4njbj.bib",
  "cited_by": 0,
  "doi": "10.1371/journal.pone.0354740",
  "fulltext_url": null,
  "id": "dtyxqt4g4njbj",
  "issns": [
    "1932-6203"
  ],
  "landing_url": "https://doi.org/10.1371/journal.pone.0354740",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "journal",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "openalex",
      "1702|Reinforcement Learning in Robotics"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Cognitive science/Cognitive psychology/Learning"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Learning and memory/Learning"
    ],
    [
      "plos",
      "/Biology and life sciences/Psychology/Cognitive psychology/Learning"
    ],
    [
      "plos",
      "/Computer and information sciences/Systems science/Nonlinear dynamics"
    ],
    [
      "plos",
      "/Computer and information sciences/Systems science/Nonlinear systems"
    ],
    [
      "plos",
      "/Engineering and technology/Electrical engineering/Electrical faults"
    ],
    [
      "plos",
      "/Engineering and technology/Mechanical engineering/Actuators"
    ],
    [
      "plos",
      "/Engineering and technology/Mechanical engineering/Robotics"
    ],
    [
      "plos",
      "/Engineering and technology/Mechanical engineering/Robotics/Robots"
    ],
    [
      "plos",
      "/Physical sciences/Mathematics/Systems science/Nonlinear dynamics"
    ],
    [
      "plos",
      "/Physical sciences/Mathematics/Systems science/Nonlinear systems"
    ],
    [
      "plos",
      "/Physical sciences/Physics/Classical mechanics/Motion/Torque"
    ],
    [
      "plos",
      "/Social sciences/Psychology/Cognitive psychology/Learning"
    ]
  ],
  "openalex": "W7220680290",
  "pdf_url": "https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0354740&type=printable",
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-06",
  "publisher": "Public Library of Science",
  "ris": "https://research.draconitic.com/paper/dtyxqt4g4njbj.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:17:30Z",
      "native_id": "10.1371/journal.pone.0354740",
      "source": "plos",
      "url": "https://doi.org/10.1371/journal.pone.0354740"
    }
  ],
  "subjects": [
    {
      "field": "biology",
      "origin": "plos:neuroscience",
      "subfield": "neuroscience"
    }
  ],
  "title": "Robust disturbance-aware actor–critic reinforcement learning for multi-DOF robotic manipulators",
  "title_text": "Robust disturbance-aware actor–critic reinforcement learning for multi-DOF robotic manipulators",
  "type": "peer-reviewed",
  "updated_at": "2026-10-30T12:17:30Z",
  "url": "https://research.draconitic.com/paper/dtyxqt4g4njbj",
  "venue": "PLOS One",
  "versions": []
}