Sionna Bench: Towards Benchmarks in Wireless Communications
Abstract
Academic research in wireless communications has no tradition of benchmarks so far. Remarkable progress in benchmark-oriented fields like machine learning suggests that the adoption of benchmarks could benefit our field. In the absence of benchmarks, however, a scientific debt has accumulated: since the academic community has not canonized specific problem setups, methods that address essentially the same problem were often developed for slightly different setups and lack a common framework for comparison. Any attempt to establish a new benchmark is faced with the challenge of resolving this debt. Recent advances in agentic artificial intelligence (AI) create an opportunity to do so by leveraging AI-assisted coding. This makes it possible to implement the state-of-the art at scale and to adapt it to a common framework for comparison. We present Sionna Bench to initiate benchmarks in academic wireless communications research. As a pilot study, we use the problem of MIMO-OFDM channel estimation. At the time of writing, Sionna Bench's channel estimation benchmark features twenty channel estimation methods that were implemented from ten different papers. The ability to compare methods against the state-of-the-art will be crucial for navigating the research landscape in an era where AI-generated methods coexist with human-developed algorithms.
Related
- Design of a Speech Enhancement-Based Deep Semantic Autoencoder for Wireless Communications
- Antenna Coding by Pixel Antennas: Unlocking A New Dimension for Wireless Communications
- Cold-Atom Rydberg Array with Spatiotemporal Multiplexing for High-Sensitivity Wireless Communications
- Secure Wireless Communications with Flexible Reflectors: Joint Position and Rotation Optimization for Physical Layer Security
- Dissipative Systems Analysis and Control. Theory and Applications: Erratum/Addendum. Springer Nature Switzerland AG, Communications and Control Engineering, Third uncorrected Edition, 2020
BibTeX
@misc{marti2026sionna,
title = {{Sionna Bench: Towards Benchmarks in Wireless Communications}},
author = {Gian Marti and Jakob Hoydis and Fayçal Aït Aoudia and Sebastian Cammerer and Alexander Keller},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.27174},
eprint = {2610.27174},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.27174},
}
RIS
TY - UNPB
TI - Sionna Bench: Towards Benchmarks in Wireless Communications
AU - Gian Marti
AU - Jakob Hoydis
AU - Fayçal Aït Aoudia
AU - Sebastian Cammerer
AU - Alexander Keller
PY - 2026
DA - 2026/10/19
PB - arXiv
DO - 10.48550/arxiv.2610.27174
UR - https://arxiv.org/abs/2610.27174
AB - Academic research in wireless communications has no tradition of benchmarks so far. Remarkable progress in benchmark-oriented fields like machine learning suggests that the adoption of benchmarks could benefit our field. In the absence of benchmarks, however, a scientific debt has accumulated: since the academic community has not canonized specific problem setups, methods that address essentially the same problem were often developed for slightly different setups and lack a common framework for comparison. Any attempt to establish a new benchmark is faced with the challenge of resolving this debt. Recent advances in agentic artificial intelligence (AI) create an opportunity to do so by leveraging AI-assisted coding. This makes it possible to implement the state-of-the art at scale and to adapt it to a common framework for comparison. We present Sionna Bench to initiate benchmarks in academic wireless communications research. As a pilot study, we use the problem of MIMO-OFDM channel estimation. At the time of writing, Sionna Bench's channel estimation benchmark features twenty channel estimation methods that were implemented from ten different papers. The ability to compare methods against the state-of-the-art will be crucial for navigating the research landscape in an era where AI-generated methods coexist with human-developed algorithms.
ER -