Diagnose Harmonisation (DHARM): An open-source tool for the harmonisation and analysis of batch effects in MRI-derived measures.
- 1University of Oxford
Abstract
Technical differences between scanners, acquisition protocols, machine hardware and processing pipelines can introduce systematic variation into MRI-derived measures. Numerous harmonisation methods have been developed to reduce these effects. However, validation of these methods is often performed using different criteria depending on the method itself, the datasets used and the study design. Consequently, determining whether harmonisation is required, selecting an appropriate method and establishing whether or not technical variation has been sufficiently removed without compromising biological signal remain challenging. In this manuscript, we introduce Diagnose Harmonisation (DHARM), an open-source Python toolbox for diagnosing batch effects, applying harmonisation and evaluating harmonisation performance in cross-sectional and repeated-measures settings. DHARM is user-friendly, comes with GUI-based and command-line interfaces, and has graphical reporting. It provides standardised reporting workflows combining complementary measures of batch-associated differences in feature location, scale, empirical distributions, covariance and multivariate structure, together with measures assessing preservation of biological covariate effects and repeated-measures consistency. The framework includes several established harmonisation approaches, but its evaluation workflow is method-agnostic: users can also supply data harmonised using external or newly developed methods and benchmark their outputs using the same common set of diagnostics. We demonstrate DHARM using multisite cross-sectional MRI measures from UK Biobank, Cam-CAN and OxBAC as well as travelling-heads data from the ON-Harmony dataset. Across the cross-sectional datasets, harmonisation substantially reduced additive batch effects, while residual differences in variance and empirical distributions varied between methods. Multivariate diagnostics further demonstrated that reduction of batch-associated structure can coexist with preservation or increased detectability of biologically relevant variation. In the repeated-measures example, harmonisation reduced batch-associated and within-subject variability, while broadly preserving subject-level and biological relationships. DHARM provides a reproducible framework for diagnosing batch effects, applying different harmonisation methods and evaluating harmonisation as a multi-criteria problem rather than relying on a single measure of success. By jointly characterising technical variation and preservation of biologically meaningful information, DHARM can support dataset- and objective-specific selection, benchmarking and validation of harmonisation strategies.
Related
- Local ETM+ to OLI EVI Harmonisation in Tropical Forest Environments
- Establishing the Minimal Clinically Important Difference (MCID) for Smartphone-Derived Gait Measures in Multiple Sclerosis
- A rare pre-existing progenitor-like Primed SMC compartment is the dominant inferred source of SMC-derived cellularity in vascular injury and atherosclerosis
- TaxHarmonizeR: A data-driven taxonomic harmonisation tool for ecological datasets
- Wolffia globosa -derived nanovesicles as a natural source of bioactive metabolites with neuroprotective potential against methylglyoxal-induced oxidative stress
BibTeX
@misc{turnbull2026diagnose,
title = {{Diagnose Harmonisation (DHARM): An open-source tool for the harmonisation and analysis of batch effects in MRI-derived measures.}},
author = {J. Turnbull and G. Bhalerao and T. E. Nichols and P. McCarthy and G. Gillis and J. Blane and B. Zhaoyi Mo and S. Warrington and S. N. Sotiropoulos and R. Besenczi and F. Alfaro-Almagro and S. M. Smith and L. Griffanti},
howpublished = {bioRxiv},
year = {2026},
month = oct,
doi = {10.64898/2026.10.30.763051},
url = {https://www.biorxiv.org/content/10.64898/2026.10.30.763051v1},
note = {CC BY},
}
RIS
TY - UNPB
TI - Diagnose Harmonisation (DHARM): An open-source tool for the harmonisation and analysis of batch effects in MRI-derived measures.
AU - J. Turnbull
AU - G. Bhalerao
AU - T. E. Nichols
AU - P. McCarthy
AU - G. Gillis
AU - J. Blane
AU - B. Zhaoyi Mo
AU - S. Warrington
AU - S. N. Sotiropoulos
AU - R. Besenczi
AU - F. Alfaro-Almagro
AU - S. M. Smith
AU - L. Griffanti
PY - 2026
DA - 2026/10/30
PB - bioRxiv
DO - 10.64898/2026.10.30.763051
UR - https://www.biorxiv.org/content/10.64898/2026.10.30.763051v1
AB - Technical differences between scanners, acquisition protocols, machine hardware and processing pipelines can introduce systematic variation into MRI-derived measures. Numerous harmonisation methods have been developed to reduce these effects. However, validation of these methods is often performed using different criteria depending on the method itself, the datasets used and the study design. Consequently, determining whether harmonisation is required, selecting an appropriate method and establishing whether or not technical variation has been sufficiently removed without compromising biological signal remain challenging. In this manuscript, we introduce Diagnose Harmonisation (DHARM), an open-source Python toolbox for diagnosing batch effects, applying harmonisation and evaluating harmonisation performance in cross-sectional and repeated-measures settings. DHARM is user-friendly, comes with GUI-based and command-line interfaces, and has graphical reporting. It provides standardised reporting workflows combining complementary measures of batch-associated differences in feature location, scale, empirical distributions, covariance and multivariate structure, together with measures assessing preservation of biological covariate effects and repeated-measures consistency. The framework includes several established harmonisation approaches, but its evaluation workflow is method-agnostic: users can also supply data harmonised using external or newly developed methods and benchmark their outputs using the same common set of diagnostics. We demonstrate DHARM using multisite cross-sectional MRI measures from UK Biobank, Cam-CAN and OxBAC as well as travelling-heads data from the ON-Harmony dataset. Across the cross-sectional datasets, harmonisation substantially reduced additive batch effects, while residual differences in variance and empirical distributions varied between methods. Multivariate diagnostics further demonstrated that reduction of batch-associated structure can coexist with preservation or increased detectability of biologically relevant variation. In the repeated-measures example, harmonisation reduced batch-associated and within-subject variability, while broadly preserving subject-level and biological relationships. DHARM provides a reproducible framework for diagnosing batch effects, applying different harmonisation methods and evaluating harmonisation as a multi-criteria problem rather than relying on a single measure of success. By jointly characterising technical variation and preservation of biologically meaningful information, DHARM can support dataset- and objective-specific selection, benchmarking and validation of harmonisation strategies.
ER -