MSF-Net: A multimodal SAR-Optical fusion network for agricultural land use classification in smallholder landscapes of Northern Benin
Abstract
Accurate crop type mapping in Sub-Saharan Africa is a challenging task, due to the presence of smallholder farming systems characterized by fragmented landscapes and heterogeneous cropping practices. Persistent cloud cover, particularly significant during the cropping season, systematically limits the exploitation of optical satellite image time series, making things even harder. This study proposes MSF-Net (Multimodal Sentinel Fusion Network), a convolutional neural network-based late-fusion framework that combines Sentinel-1 synthetic aperture radar and Sentinel-2 multispectral time series for multi-class crop classification in the complex agricultural landscapes of central and northern Benin. The model was evaluated across six sites and three growing seasons (2022–2024) covering 12 land cover classes and compared with a Sentinel-2-only Temporal Convolutional Neural Network (TempCNN), a SAR-only baseline (S1-Branch), an ablated version of the proposed method, and two external state-of-the-art multimodal architectures, TSViT and TWINNS. MSF-Net achieved the highest or joint-highest overall accuracy in 10 of 14 site–year configurations, with overall accuracy ranging from 82.61% to 91.15% and kappa coefficients from 0.79 to 0.89, consistently outperforming both external baselines across all site–year configurations. The largest gains over TempCNN reached up to 30 percentage points for spectrally ambiguous classes such as Shrubby Savannah, Cotton, and Open Forest. In addition, MSF-Net produced more spatially coherent maps, with reduced salt-and-pepper noise, improved parcel-level homogeneity, and fewer modality-specific artefacts. These results demonstrate the value of SAR-optical fusion for operational crop monitoring in tropical West Africa.
Related
- Local disease risk management practices and barriers to vaccination against peste des petits ruminants among smallholder sheep and goat farmers in northern Nigeria
- Private forest reserves in Brazils agricultural landscapes effectively sustain the occupancy and abundance of multiple threatened large vertebrate
- Nature’s Complexity for Crop Protection: Integrating Botanical Solutions into Biodiverse Agricultural Landscapes
- Options for mitigating multi-stressor interactions on managed bees in European agricultural landscapes
- Shared landscapes, shared risk: Echinococcus multilocularis infection in coyotes is linked to agricultural land and altered green space in a major U.S. metropolitan area
BibTeX
@article{sare2026msfnet,
title = {{MSF-Net: A multimodal SAR-Optical fusion network for agricultural land use classification in smallholder landscapes of Northern Benin}},
author = {Sabi Bruno Bio Nikki Sare and Raffaele Gaetano and Yvon-Carmen Hountondji and Roberto Interdonato},
journal = {Remote Sensing},
year = {2026},
month = aug,
doi = {10.3390/rs18152622},
url = {https://hal.science/hal-05858375v1},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - MSF-Net: A multimodal SAR-Optical fusion network for agricultural land use classification in smallholder landscapes of Northern Benin
AU - Sabi Bruno Bio Nikki Sare
AU - Raffaele Gaetano
AU - Yvon-Carmen Hountondji
AU - Roberto Interdonato
PY - 2026
DA - 2026/08/06
JO - Remote Sensing
DO - 10.3390/rs18152622
UR - https://hal.science/hal-05858375v1
AB - Accurate crop type mapping in Sub-Saharan Africa is a challenging task, due to the presence of smallholder farming systems characterized by fragmented landscapes and heterogeneous cropping practices. Persistent cloud cover, particularly significant during the cropping season, systematically limits the exploitation of optical satellite image time series, making things even harder. This study proposes MSF-Net (Multimodal Sentinel Fusion Network), a convolutional neural network-based late-fusion framework that combines Sentinel-1 synthetic aperture radar and Sentinel-2 multispectral time series for multi-class crop classification in the complex agricultural landscapes of central and northern Benin. The model was evaluated across six sites and three growing seasons (2022–2024) covering 12 land cover classes and compared with a Sentinel-2-only Temporal Convolutional Neural Network (TempCNN), a SAR-only baseline (S1-Branch), an ablated version of the proposed method, and two external state-of-the-art multimodal architectures, TSViT and TWINNS. MSF-Net achieved the highest or joint-highest overall accuracy in 10 of 14 site–year configurations, with overall accuracy ranging from 82.61% to 91.15% and kappa coefficients from 0.79 to 0.89, consistently outperforming both external baselines across all site–year configurations. The largest gains over TempCNN reached up to 30 percentage points for spectrally ambiguous classes such as Shrubby Savannah, Cotton, and Open Forest. In addition, MSF-Net produced more spatially coherent maps, with reduced salt-and-pepper noise, improved parcel-level homogeneity, and fewer modality-specific artefacts. These results demonstrate the value of SAR-optical fusion for operational crop monitoring in tropical West Africa.
SN - 2072-4292
ER -