Reinforcement Learning and Operational Research: A Review of Methodological Integration and Research Directions
Abstract
The growing demand for real-time, data-driven decision-making in complex and dynamic systems is placing increasing pressure on Operational Research (OR) methodologies. Sequential decision-making under uncertainty has long been studied in OR through Markov decision processes, dynamic programming, and their approximations, and reinforcement learning (RL) provides simulation-based methods for learning decision policies in such problems. Recent research shows an increasing interest in integrating RL with OR to address dynamic decision-making problems and enhance heuristic and exact methods for combinatorial optimization. The overarching goal across these efforts is to improve solution quality, computational efficiency, and robustness. Given the diversity of integration approaches and application settings, there is a clear need for a systematic and technically detailed review of how RL empowers OR methods. To address this gap, this paper presents a structured review of two methodological roles of RL in OR. The first concerns sequential decision problems in dynamic environments, where states evolve and decisions are repeated over time. The second concerns static combinatorial optimization problems, where inputs are fixed before the solution process begins and RL either constructs solutions or supports heuristic and exact algorithms. Digital twins provide an optional deployment and evaluation layer for training, testing, and validating these methods. We critically synthesize recent advances across these roles and uses, highlighting their advantages, implementation requirements, limitations, and challenges. Finally, we consolidate guidance on when the reviewed approaches may be considered and outline directions for future research on the methodological and practical integration of RL and OR.
Related
- Integration against POVMs in von Neumann algebras and Operational Quantum Reference Frames
- Reinforcement Learning Under Runtime Confounding: Policy Learning and Off-Policy Evaluation
- Deep Reinforcement Learning for Blind Passive Beamforming in RIS-Assisted MIMO Systems
- Psychometric properties of the Persian version of the self-regulated learning scale in clinical nursing practice for nursing students: A methodological study
- Toward Maximizing Algebraic Connectivity via Density-Dependent Backbone Construction and Reinforcement Learning Completion
BibTeX
@misc{lu2026reinforcement,
title = {{Reinforcement Learning and Operational Research: A Review of Methodological Integration and Research Directions}},
author = {Yahan Lu and Dongyang Xia and Nursen Aydin and Shadi Sharif Azadeh},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2609.24750},
eprint = {2609.24750},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.24750},
note = {CC BY-NC-ND 4.0},
}
RIS
TY - UNPB
TI - Reinforcement Learning and Operational Research: A Review of Methodological Integration and Research Directions
AU - Yahan Lu
AU - Dongyang Xia
AU - Nursen Aydin
AU - Shadi Sharif Azadeh
PY - 2026
DA - 2026/10/21
PB - arXiv
DO - 10.48550/arxiv.2609.24750
UR - https://arxiv.org/abs/2609.24750
AB - The growing demand for real-time, data-driven decision-making in complex and dynamic systems is placing increasing pressure on Operational Research (OR) methodologies. Sequential decision-making under uncertainty has long been studied in OR through Markov decision processes, dynamic programming, and their approximations, and reinforcement learning (RL) provides simulation-based methods for learning decision policies in such problems. Recent research shows an increasing interest in integrating RL with OR to address dynamic decision-making problems and enhance heuristic and exact methods for combinatorial optimization. The overarching goal across these efforts is to improve solution quality, computational efficiency, and robustness. Given the diversity of integration approaches and application settings, there is a clear need for a systematic and technically detailed review of how RL empowers OR methods. To address this gap, this paper presents a structured review of two methodological roles of RL in OR. The first concerns sequential decision problems in dynamic environments, where states evolve and decisions are repeated over time. The second concerns static combinatorial optimization problems, where inputs are fixed before the solution process begins and RL either constructs solutions or supports heuristic and exact algorithms. Digital twins provide an optional deployment and evaluation layer for training, testing, and validating these methods. We critically synthesize recent advances across these roles and uses, highlighting their advantages, implementation requirements, limitations, and challenges. Finally, we consolidate guidance on when the reviewed approaches may be considered and outline directions for future research on the methodological and practical integration of RL and OR.
ER -