MTF-Net: a brain tumor segmentation network with multi-scale transformer and feature fusion enhancement
- 1School of Information and Communication Engineering, North University of China, Taiyuan, China
- 2School of New Energy, Inner Mongolia University of Technology, Ordos, China
Abstract
To address the issues of insufficient multimodal information fusion and inadequate long-range feature extraction in brain tumor segmentation, we propose a brain tumor segmentation network based on multi-scale Transformer and feature fusion enhancement (MTF-Net). In the second to fourth encoding layers of MTF-Net, the multi-scale and spatially-aware Transformer module (MSFormer) effectively integrates multi-scale deep convolution with spatially-aware MLP to perform local-global joint modeling under different receptive fields. Additionally, the last layer of the encoder employs a Channel-Enhanced Bi-level Attention Module (CEBAM), which combines a dual-layer sparse attention mechanism with a channel enhancement structure to enhance the capability of expressing long-range dependencies. Then, in the bridging section of the encoder-decoder, a Cross-Modal Feature Interaction Module (CFIM) is used to guide the fusion of features from MSFormer and the convolutional branch, improving boundary perception and consistency across modalities. Finally, we uses a hybrid loss function composed of binary cross entropy (BCE) and Dice Loss to alleviate the issue of class imbalance. Experimental results on the BraTS2019 brain tumor dataset show that the model achieves average Dice coefficients of 0.926, 0.921, and 0.896 for whole tumor, tumor core, and enhancing tumor, respectively. Experimental results on the BraTS2021 brain tumor dataset show that the model achieves average Dice coefficients of 0.918, 0.923, and 0.901 for whole tumor, tumor core, and enhancing tumor, respectively. Compared with the evaluated segmentation methods, the proposed model achieves competitive segmentation performance across the three tumor subregions.
Related
- A segmentation-guided CNN–Vision transformer feature fusion framework for multi-class breast ultrasound image classification
- Hybrid feature pyramid attention and capsule network (FpaNet+CapsNet) for enhanced spatial and contextual feature extraction for improved brain tumor segmentation
- UAV image segmentation in complex mining areas by integrating spatially adaptive feature modulation and multi-scale context fusion modules
- Rethinking underwater image enhancement via a hybrid Mamba–transformer network
- Transformer-Convolution Pyramid Network for Multi-Class Kidney, Tumor, and Cyst Segmentation
BibTeX
@article{liu2026mtfnet,
title = {{MTF-Net: a brain tumor segmentation network with multi-scale transformer and feature fusion enhancement}},
author = {Wenyan Liu and Yajie Cao and Yi Liu and Pengcheng Zhang and Zhiguo Gui and Lili Liu},
journal = {Frontiers in Medicine},
year = {2026},
month = oct,
doi = {10.3389/fmed.2026.1934161},
url = {https://doi.org/10.3389/fmed.2026.1934161},
note = {CC BY},
}
RIS
TY - JOUR
TI - MTF-Net: a brain tumor segmentation network with multi-scale transformer and feature fusion enhancement
AU - Wenyan Liu
AU - Yajie Cao
AU - Yi Liu
AU - Pengcheng Zhang
AU - Zhiguo Gui
AU - Lili Liu
PY - 2026
DA - 2026/10/26
JO - Frontiers in Medicine
DO - 10.3389/fmed.2026.1934161
UR - https://doi.org/10.3389/fmed.2026.1934161
AB - To address the issues of insufficient multimodal information fusion and inadequate long-range feature extraction in brain tumor segmentation, we propose a brain tumor segmentation network based on multi-scale Transformer and feature fusion enhancement (MTF-Net). In the second to fourth encoding layers of MTF-Net, the multi-scale and spatially-aware Transformer module (MSFormer) effectively integrates multi-scale deep convolution with spatially-aware MLP to perform local-global joint modeling under different receptive fields. Additionally, the last layer of the encoder employs a Channel-Enhanced Bi-level Attention Module (CEBAM), which combines a dual-layer sparse attention mechanism with a channel enhancement structure to enhance the capability of expressing long-range dependencies. Then, in the bridging section of the encoder-decoder, a Cross-Modal Feature Interaction Module (CFIM) is used to guide the fusion of features from MSFormer and the convolutional branch, improving boundary perception and consistency across modalities. Finally, we uses a hybrid loss function composed of binary cross entropy (BCE) and Dice Loss to alleviate the issue of class imbalance. Experimental results on the BraTS2019 brain tumor dataset show that the model achieves average Dice coefficients of 0.926, 0.921, and 0.896 for whole tumor, tumor core, and enhancing tumor, respectively. Experimental results on the BraTS2021 brain tumor dataset show that the model achieves average Dice coefficients of 0.918, 0.923, and 0.901 for whole tumor, tumor core, and enhancing tumor, respectively. Compared with the evaluated segmentation methods, the proposed model achieves competitive segmentation performance across the three tumor subregions.
SN - 2296-858X
ER -