Attention-based Spatio-Temporal Graph Convolutional Networks-enhanced deep reinforcement learning for adaptive traffic signal control in urban traffic networks
- 1China Communications Information & Technology Group
- 2College of electronic and information engineering, Tongji University
Abstract
Urban traffic congestion remains a critical challenge due to the inflexibility of conventional fixed-time or rule-based traffic signal control systems, which cannot adapt to real-time dynamic traffic flows. Existing deep reinforcement learning (DRL)-based adaptive signal control methods often neglect complex spatio-temporal dependencies in urban road networks, and graph-based spatio-temporal models (e.g., ASTGCN) are mostly limited to traffic flow prediction rather than signal control optimization. To address these gaps, this study proposes a novel adaptive traffic signal control framework by integrating Attention-based Spatio-Temporal Graph Convolutional Networks (ASTGCN) with Multi-Agent Deep Deterministic Policy Gradient (MADDPG). The ASTGCN module effectively captures spatial topological correlations and temporal dynamic patterns of traffic flow via graph attention and temporal convolution, while the MADDPG framework realizes centralized training and decentralized execution to solve multi-intersection cooperative control under partial observability. Experiments are conducted on the SUMO simulation platform with a four-intersection road network, using both real-world and stochastic traffic flows for validation. Comparative results with fixed-time control, Max-Pressure, centralized/distributed DRL, and vanilla MADDPG baselines show that the proposed method reduces traffic congestion by 20%–25% and achieves superior performance in convergence speed, generalization ability, extreme traffic load resilience, and non-uniform traffic adaptation. Ablation studies further verify the effectiveness of the ASTGCN-based spatio-temporal feature extraction component. This framework provides a scalable and data-driven solution for intelligent traffic signal control in urban traffic networks, supporting the development of smart mobility systems.
Related
- CBAM-enhanced convolutional networks for diabetic retinopathy classification in the ODIR dataset
- COVLIAS 3.5: integration of attention-based segmentation technique with fuzzy dilated convolutional neural networks for improved classification of chest X-ray scans for multiclass pneumonia diagnosis
- Feature-aware attention convolutional neural network for efficient pulmonary fibrosis classification from chest CT images with FPGA deployment
- Interpretable attention-deficit hyperactivity disorder diagnosis from functional magnetic resonance imaging via hybrid convolutional neural network–transformer learning and multi-level graph-based comprehensibility
- MedFuse: dual-stream fusion of convolutional and vision transformer-based features for enhanced medical image classification
BibTeX
@article{wang2026attentionbased,
title = {{Attention-based Spatio-Temporal Graph Convolutional Networks-enhanced deep reinforcement learning for adaptive traffic signal control in urban traffic networks}},
author = {Jing Wang and Xiaopeng Wang and Yang Mo and Chao Huang and Yanan Li and Guanghe Li and Hao Zhang},
journal = {Scientific Reports},
year = {2026},
month = jul,
doi = {10.1038/s41598-026-61371-3},
url = {https://doi.org/10.1038/s41598-026-61371-3},
note = {CC BY},
}
RIS
TY - JOUR
TI - Attention-based Spatio-Temporal Graph Convolutional Networks-enhanced deep reinforcement learning for adaptive traffic signal control in urban traffic networks
AU - Jing Wang
AU - Xiaopeng Wang
AU - Yang Mo
AU - Chao Huang
AU - Yanan Li
AU - Guanghe Li
AU - Hao Zhang
PY - 2026
DA - 2026/07/01
JO - Scientific Reports
DO - 10.1038/s41598-026-61371-3
UR - https://doi.org/10.1038/s41598-026-61371-3
AB - Urban traffic congestion remains a critical challenge due to the inflexibility of conventional fixed-time or rule-based traffic signal control systems, which cannot adapt to real-time dynamic traffic flows. Existing deep reinforcement learning (DRL)-based adaptive signal control methods often neglect complex spatio-temporal dependencies in urban road networks, and graph-based spatio-temporal models (e.g., ASTGCN) are mostly limited to traffic flow prediction rather than signal control optimization. To address these gaps, this study proposes a novel adaptive traffic signal control framework by integrating Attention-based Spatio-Temporal Graph Convolutional Networks (ASTGCN) with Multi-Agent Deep Deterministic Policy Gradient (MADDPG). The ASTGCN module effectively captures spatial topological correlations and temporal dynamic patterns of traffic flow via graph attention and temporal convolution, while the MADDPG framework realizes centralized training and decentralized execution to solve multi-intersection cooperative control under partial observability. Experiments are conducted on the SUMO simulation platform with a four-intersection road network, using both real-world and stochastic traffic flows for validation. Comparative results with fixed-time control, Max-Pressure, centralized/distributed DRL, and vanilla MADDPG baselines show that the proposed method reduces traffic congestion by 20%–25% and achieves superior performance in convergence speed, generalization ability, extreme traffic load resilience, and non-uniform traffic adaptation. Ablation studies further verify the effectiveness of the ASTGCN-based spatio-temporal feature extraction component. This framework provides a scalable and data-driven solution for intelligent traffic signal control in urban traffic networks, supporting the development of smart mobility systems.
SN - 2045-2322
ER -