Continuous control deep reinforcement learning for joint resource optimization in STAR-RIS assisted mmWave-NOMA systems with hardware impairments
4 affiliations
- 1Electrical and Computer Engineering Department, University of Mohaghegh Ardabili
- 2Electrical Engineering Department, Sharif University of Technology
- 3School of Electrical and Electronic Engineering, Nanyang Technological University
- 4Centre for Telecommunication Research and Innovation (CeTRI), Faculty of Electronic and Computer Technology and Engineering, Universiti Teknikal Malaysia Melaka (UTeM)
Abstract
This paper proposes a continuous-control deep reinforcement learning (DRL) framework for the joint optimization of power allocation, hybrid beamforming, and phase-shift configuration in simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS)-assisted millimeter-wave non-orthogonal multiple access (mmWave-NOMA) networks. The proposed system supports heterogeneous services, including enhanced mobile broadband (eMBB) and ultra-reliable low-latency communication (uRLLC), by maximizing the minimum signal-to-interference-plus-noise ratio (SINR) among users while satisfying quality-of-service requirements. Practical hardware impairments, including imperfect successive interference cancellation (SIC) and in-phase and quadrature imbalance (IQI), are explicitly incorporated into the system model to capture residual interference and transceiver distortions. A continuous-control DRL framework based on Softmax Deep Double Deterministic Policy Gradients (SD3) is developed to jointly optimize the network resources under these non-ideal conditions. Extensive simulation results demonstrate that the proposed STAR-RIS-assisted SD3 framework consistently outperforms conventional RIS-based schemes and benchmark DRL algorithms in terms of achievable sum rate and convergence performance. Furthermore, robustness evaluations under imperfect channel state information (CSI), varying hardware impairment levels, and different Rician fading conditions show that the proposed approach maintains superior performance despite channel uncertainty and practical transceiver impairments, highlighting its effectiveness for next-generation mmWave communication systems.
Related
- Adaptive intelligent resource optimization in wireless sensor networks using reinforcement learning and compressive sensing
- Digital Twin Workflow for Continuous Glucose Forecasting: Real-Time Data Assimilation Using Reinforcement Learning
- Deep reinforcement learning-based resource recommendation system for ideological and political education
- Multiproperty optimization of therapeutic antibodies through sequence editing via large language model and reinforcement learning
- Retail sales optimization using a hybrid K-Means, particle swarm optimization and reinforcement learning framework
BibTeX
@article{sobhigivi2026continuous,
title = {{Continuous control deep reinforcement learning for joint resource optimization in STAR-RIS assisted mmWave-NOMA systems with hardware impairments}},
author = {Sima Sobhi-Givi and Mahdi Nouri and Mousa Abdollahvand and Hamid Behroozi and Zhiguo Ding and Zahriladha Zakaria},
journal = {Scientific Reports},
year = {2026},
month = aug,
doi = {10.1038/s41598-026-66689-6},
url = {https://doi.org/10.1038/s41598-026-66689-6},
note = {CC BY},
}
RIS
TY - JOUR
TI - Continuous control deep reinforcement learning for joint resource optimization in STAR-RIS assisted mmWave-NOMA systems with hardware impairments
AU - Sima Sobhi-Givi
AU - Mahdi Nouri
AU - Mousa Abdollahvand
AU - Hamid Behroozi
AU - Zhiguo Ding
AU - Zahriladha Zakaria
PY - 2026
DA - 2026/08/01
JO - Scientific Reports
DO - 10.1038/s41598-026-66689-6
UR - https://doi.org/10.1038/s41598-026-66689-6
AB - This paper proposes a continuous-control deep reinforcement learning (DRL) framework for the joint optimization of power allocation, hybrid beamforming, and phase-shift configuration in simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS)-assisted millimeter-wave non-orthogonal multiple access (mmWave-NOMA) networks. The proposed system supports heterogeneous services, including enhanced mobile broadband (eMBB) and ultra-reliable low-latency communication (uRLLC), by maximizing the minimum signal-to-interference-plus-noise ratio (SINR) among users while satisfying quality-of-service requirements. Practical hardware impairments, including imperfect successive interference cancellation (SIC) and in-phase and quadrature imbalance (IQI), are explicitly incorporated into the system model to capture residual interference and transceiver distortions. A continuous-control DRL framework based on Softmax Deep Double Deterministic Policy Gradients (SD3) is developed to jointly optimize the network resources under these non-ideal conditions. Extensive simulation results demonstrate that the proposed STAR-RIS-assisted SD3 framework consistently outperforms conventional RIS-based schemes and benchmark DRL algorithms in terms of achievable sum rate and convergence performance. Furthermore, robustness evaluations under imperfect channel state information (CSI), varying hardware impairment levels, and different Rician fading conditions show that the proposed approach maintains superior performance despite channel uncertainty and practical transceiver impairments, highlighting its effectiveness for next-generation mmWave communication systems.
SN - 2045-2322
ER -