Deep Reinforcement Learning-Aided Optimization of Multi-Interface Allocation for Short-Packet Communications
Abstract
The severe spectrum scarcity and the stringent requirements of Beyond 5G applications call for an integrated use of low frequency Sub-6 GHz and high frequency millimeter Wave bands. Focusing on future Internet of Things (IoT) Short-Packet Communications (SPC), this paper investigates the optimized usage of such diverse wireless interfaces. We propose an unifying framework devoted to SPC that jointly optimizes the user partitioning over each band, and the radio resource scheduling within each band. Leveraging Deep Reinforcement Learning (DRL) tools, the proposed method enables to better tackle the challenges imposed by dynamically varying mobile environments such as the Line-of-Sight situations of each link, and the heterogeneity of individual Quality of Service (QoS) requirements, such as rate, delay and reliability. Regarding the DRL-based user partitioning to each band, we have investigated three different types of partitioning actions to obtain a high network performance as well as a rapid convergence. Regarding the proposed sub-schedulers within each band, we designed two optimization methods, i.e., one that leverages Difference of Convex Programming (DCP) technique, and the second that accelerates convergence to a local optimum. Numerical evaluations show that the proposed methods outperform conventional approaches in terms of sum-rate and QoS outage probabilities.
Related
- Efficient Joint Trajectory Optimization and Resource Allocation for Secure UAV Networks: A Deep Reinforcement Learning Approach
- Deep Reinforcement Learning for BD-RIS-Assisted Multi-UAV RSMA Communications
- Transformer-Based Reinforcement Learning for Phase I Dose Allocation
- Reinforcement learning-driven optimal capital allocation for intelligent finance
- Extending graph metrics to hyperspaces of vertex sets: optimization and reinforcement learning applications
BibTeX
@article{oliveira2026deep,
title = {{Deep Reinforcement Learning-Aided Optimization of Multi-Interface Allocation for Short-Packet Communications}},
author = {Hugo de Oliveira and Megumi Kaneko and Lila Boukhatem and Ellen Hidemi Fukuda},
journal = {IEEE Transactions on Cognitive Communications and Networking},
year = {2026},
month = sep,
doi = {10.1109/tccn.2023.3252661},
url = {https://hal.science/hal-03944071v1},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - Deep Reinforcement Learning-Aided Optimization of Multi-Interface Allocation for Short-Packet Communications
AU - Hugo de Oliveira
AU - Megumi Kaneko
AU - Lila Boukhatem
AU - Ellen Hidemi Fukuda
PY - 2026
DA - 2026/09/17
JO - IEEE Transactions on Cognitive Communications and Networking
DO - 10.1109/tccn.2023.3252661
UR - https://hal.science/hal-03944071v1
AB - The severe spectrum scarcity and the stringent requirements of Beyond 5G applications call for an integrated use of low frequency Sub-6 GHz and high frequency millimeter Wave bands. Focusing on future Internet of Things (IoT) Short-Packet Communications (SPC), this paper investigates the optimized usage of such diverse wireless interfaces. We propose an unifying framework devoted to SPC that jointly optimizes the user partitioning over each band, and the radio resource scheduling within each band. Leveraging Deep Reinforcement Learning (DRL) tools, the proposed method enables to better tackle the challenges imposed by dynamically varying mobile environments such as the Line-of-Sight situations of each link, and the heterogeneity of individual Quality of Service (QoS) requirements, such as rate, delay and reliability. Regarding the DRL-based user partitioning to each band, we have investigated three different types of partitioning actions to obtain a high network performance as well as a rapid convergence. Regarding the proposed sub-schedulers within each band, we designed two optimization methods, i.e., one that leverages Difference of Convex Programming (DCP) technique, and the second that accelerates convergence to a local optimum. Numerical evaluations show that the proposed methods outperform conventional approaches in terms of sum-rate and QoS outage probabilities.
SN - 2332-7731
ER -