Spatial Token Interleaving and Two-Pass BP Decoding for Semantic Image Transmission
Abstract
Semantic error control coding (SECC) can correct the residual errors of a standard channel code with a foundation model that supplies a prior on the source content, but existing SECC schemes are designed for text. In this paper, we develop SECC for image transmission with spatial token interleaving and a two-pass belief propagation (BP) schedule. At the transmitter, a vector-quantized (VQ) tokenizer converts an image into tokens, which are transmitted in multiple low-density parity-check (LDPC) code blocks of fifth-generation New Radio (5G NR). In raster order, a block that BP fails to decode corrupts consecutive token rows, so the interleaver reorders the tokens such that adjacent tokens are carried by different blocks, without additional transmitted bits. At the receiver, after the first BP pass, token recovery fuses the token probabilities given by BP with the predictions of the autoregressive model Emu3-Gen, and the second BP pass decodes each block again with the fused distributions as priors on the information bits. On Kodak24 at 0.5 channel uses per pixel and a signal-to-noise ratio (SNR) of 0.15 dB, the second pass removes 92% of the token errors left by token recovery, and interleaving reduces the final token error rate by 88%. At medium to high SNR, the proposed receiver exceeds deep joint source--channel coding baselines with the same channel uses by at least 1.2 dB in peak signal-to-noise ratio.
Related
- SkillComm: Skill-Driven Semantic Communication for Sequential Workflows via Incremental Token Transmission
- From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity
- Route Based Map Matching via a Structured Codebook and Token Sequence Decoding
- Iterative Semantic Decoding for Short Block Codes
- Semantic SCL Decoding for Polar Codes
BibTeX
@misc{feng2026spatial,
title = {{Spatial Token Interleaving and Two-Pass BP Decoding for Semantic Image Transmission}},
author = {Yifan Feng and Chentao Yue and Haiyao Yu and Gaoyang Pang and Xinyu Chen and Hao Chang and Branka Vucetic and Yonghui Li},
howpublished = {arXiv},
year = {2026},
month = nov,
doi = {10.48550/arxiv.2611.00697},
eprint = {2611.00697},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2611.00697},
}
RIS
TY - UNPB
TI - Spatial Token Interleaving and Two-Pass BP Decoding for Semantic Image Transmission
AU - Yifan Feng
AU - Chentao Yue
AU - Haiyao Yu
AU - Gaoyang Pang
AU - Xinyu Chen
AU - Hao Chang
AU - Branka Vucetic
AU - Yonghui Li
PY - 2026
DA - 2026/11/01
PB - arXiv
DO - 10.48550/arxiv.2611.00697
UR - https://arxiv.org/abs/2611.00697
AB - Semantic error control coding (SECC) can correct the residual errors of a standard channel code with a foundation model that supplies a prior on the source content, but existing SECC schemes are designed for text. In this paper, we develop SECC for image transmission with spatial token interleaving and a two-pass belief propagation (BP) schedule. At the transmitter, a vector-quantized (VQ) tokenizer converts an image into tokens, which are transmitted in multiple low-density parity-check (LDPC) code blocks of fifth-generation New Radio (5G NR). In raster order, a block that BP fails to decode corrupts consecutive token rows, so the interleaver reorders the tokens such that adjacent tokens are carried by different blocks, without additional transmitted bits. At the receiver, after the first BP pass, token recovery fuses the token probabilities given by BP with the predictions of the autoregressive model Emu3-Gen, and the second BP pass decodes each block again with the fused distributions as priors on the information bits. On Kodak24 at 0.5 channel uses per pixel and a signal-to-noise ratio (SNR) of 0.15 dB, the second pass removes 92% of the token errors left by token recovery, and interleaving reduces the final token error rate by 88%. At medium to high SNR, the proposed receiver exceeds deep joint source--channel coding baselines with the same channel uses by at least 1.2 dB in peak signal-to-noise ratio.
ER -