Digital-Twin-Referenced Belief-Guided Q-Learning for Jammer Identification and Beam-Power Control in a mmWave Model
Abstract
Next-generation wireless networks are expected to support high data rates and reliable connectivity while meeting requirements for energy efficiency, resource management, and communication security. Digital Twin (DT) technology represents expected network behavior and enables the actual network state to be assessed against it. Integrating DT technology with reinforcement learning (RL) supports adaptive resource allocation and security-aware decision-making. This paper presents a simulation-based DT reference and a belief-guided Q-learning (BGQL) method for joint jammer identification and beam-power control in a site-specific 28-GHz network model. Receiver-level residuals between attack-free and attacked configurations are combined with candidate spatial jamming footprints and accumulated into a normalized suspicion vector. BGQL incorporates this vector into its state, reward, and exploratory beam-selection rule. Compared with SARSA, Greedy, and Random across 30 paired Monte Carlo runs per configuration, with known jammer counts, BGQL achieves link-rate scores of 437.4-564.2 Mbit/s, rate-to-device-power scores of 60.37-76.79 Mbit/J, and localization recall of 100% for one jammer and 78%-81% for two jammers. BGQL requires 80-130 s per run versus 5-14 s for SARSA. These findings provide a matched-model simulation proof of concept for DT-referenced belief-guided learning for security-aware beam-power control in 6G networks.
Related
- Decision-Making in Digital Twins: Optimization, Control, and Learning
- Belief-Informed Hybrid Control with Almost-Sure Target-Set Convergence
- Conflict-Free Color-Clustered Sequential Belief-Propagation Decoding of Quantum LDPC Codes via Reinforcement Learning
- Bias-Aware Adjoint Calibration and Optimal Control of Stochastic Multiscale Bioprocess Digital Twins
- Digital Learning Platforms and Mathematical Problem-Solving Ability: The Moderating Role of Self-Regulated Learning
BibTeX
@misc{geranmayeh2026digitaltwinreferenced,
title = {{Digital-Twin-Referenced Belief-Guided Q-Learning for Jammer Identification and Beam-Power Control in a mmWave Model}},
author = {Parmida Geranmayeh and Onur Günlü},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.16770},
eprint = {2610.16770},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.16770},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Digital-Twin-Referenced Belief-Guided Q-Learning for Jammer Identification and Beam-Power Control in a mmWave Model
AU - Parmida Geranmayeh
AU - Onur Günlü
PY - 2026
DA - 2026/10/23
PB - arXiv
DO - 10.48550/arxiv.2610.16770
UR - https://arxiv.org/abs/2610.16770
AB - Next-generation wireless networks are expected to support high data rates and reliable connectivity while meeting requirements for energy efficiency, resource management, and communication security. Digital Twin (DT) technology represents expected network behavior and enables the actual network state to be assessed against it. Integrating DT technology with reinforcement learning (RL) supports adaptive resource allocation and security-aware decision-making. This paper presents a simulation-based DT reference and a belief-guided Q-learning (BGQL) method for joint jammer identification and beam-power control in a site-specific 28-GHz network model. Receiver-level residuals between attack-free and attacked configurations are combined with candidate spatial jamming footprints and accumulated into a normalized suspicion vector. BGQL incorporates this vector into its state, reward, and exploratory beam-selection rule. Compared with SARSA, Greedy, and Random across 30 paired Monte Carlo runs per configuration, with known jammer counts, BGQL achieves link-rate scores of 437.4-564.2 Mbit/s, rate-to-device-power scores of 60.37-76.79 Mbit/J, and localization recall of 100% for one jammer and 78%-81% for two jammers. BGQL requires 80-130 s per run versus 5-14 s for SARSA. These findings provide a matched-model simulation proof of concept for DT-referenced belief-guided learning for security-aware beam-power control in 6G networks.
ER -