Benchmarking open-source automated thigh muscle MRI segmentation algorithms
- 1University of Miami
Abstract
Automatic segmentation of medical images could accelerate clinical and research workflows, yet existing tools are rarely compared independently on shared benchmarks, making it difficult to assess genuine progress. This is particularly consequential for limb muscle segmentation in magnetic resonance imaging (MRI), which underpins volumetric analysis, radiomics, and fat fraction quantification used as biomarkers in neuromuscular disease - applications where segmentation errors can directly affect interpretation. Despite the availability of multiple open-source segmentation tools spanning diverse architectures, no independent head-to-head comparison has appeared in the literature. We address this gap by evaluating eight tools, six of which run independently, and the other two of which are meant to be auxiliary algorithms once muscles have been somehow initially labeled. We evaluated these tools on three-dimensional MRI volumes across three base datasets and then later against derived datasets, assessing both quantitative metrics and qualitative usability. Our results reveal substantial performance variation across methods and datasets, with many methods showing reduced accuracy on pathological cases. Domain-specific models trained on large datasets consistently outperformed foundation models and newer general-purpose architectures. Our results reveal practical trade-offs between accuracy, generalizability, and ease of use that are critical for clinical adoption, while raising concerns for deployment on underrepresented populations and pathologies.
Related
- Automated thigh muscle segmentation using foundation models: validation and impact of segmentation quality
- Myocardial Stiffness Tracking & Assessment Toolkit Driven by Artificial Intelligence For Reproducible Benchmarking of Temporal Segmentation and Shear-Wave Velocity Stabilization on Synthetic Data
- CT Ventricular Volume Reference Percentile Curves Using Automated nnU-Net Segmentation: A Study with LLM-Facilitated Cohort Selection
- Automated corneal endothelial cell detection and segmentation in specular microscopy images using Attention and Faster U-Net
- Automated Segmentation of Mass Lesions in Mammography: Mask R-CNN Versus Classical Methods, Fuzzy Clustering and MedSAM
BibTeX
@misc{moore2026benchmarking,
title = {{Benchmarking open-source automated thigh muscle MRI segmentation algorithms}},
author = {C. M. Moore and M. Alper},
howpublished = {medRxiv},
year = {2026},
month = sep,
doi = {10.64898/2026.09.16.26363275},
url = {https://www.medrxiv.org/content/10.64898/2026.09.16.26363275v1},
note = {CC BY},
}
RIS
TY - UNPB
TI - Benchmarking open-source automated thigh muscle MRI segmentation algorithms
AU - C. M. Moore
AU - M. Alper
PY - 2026
DA - 2026/09/16
PB - medRxiv
DO - 10.64898/2026.09.16.26363275
UR - https://www.medrxiv.org/content/10.64898/2026.09.16.26363275v1
AB - Automatic segmentation of medical images could accelerate clinical and research workflows, yet existing tools are rarely compared independently on shared benchmarks, making it difficult to assess genuine progress. This is particularly consequential for limb muscle segmentation in magnetic resonance imaging (MRI), which underpins volumetric analysis, radiomics, and fat fraction quantification used as biomarkers in neuromuscular disease - applications where segmentation errors can directly affect interpretation. Despite the availability of multiple open-source segmentation tools spanning diverse architectures, no independent head-to-head comparison has appeared in the literature. We address this gap by evaluating eight tools, six of which run independently, and the other two of which are meant to be auxiliary algorithms once muscles have been somehow initially labeled. We evaluated these tools on three-dimensional MRI volumes across three base datasets and then later against derived datasets, assessing both quantitative metrics and qualitative usability. Our results reveal substantial performance variation across methods and datasets, with many methods showing reduced accuracy on pathological cases. Domain-specific models trained on large datasets consistently outperformed foundation models and newer general-purpose architectures. Our results reveal practical trade-offs between accuracy, generalizability, and ease of use that are critical for clinical adoption, while raising concerns for deployment on underrepresented populations and pathologies.
ER -