{
  "abstract": "ObjectivesMachine learning models for graft-versus-host disease (GVHD) after allogeneic hematopoietic stem cell transplantation (allo-HSCT) are rarely evaluated externally or for calibration. We developed explainable models for grade II-IV acute and moderate-to-severe chronic GVHD and evaluated their transportability across multiple cohorts.\n\nMaterials and methodsGradient boosting models were trained on three CIBMTR registry-derived datasets (N = 2,509) and externally evaluated in six cohorts (N = 14,788), including a Middle Eastern cohort. We assessed discrimination (AUROC), calibration (logistic recalibration intercept and slope; Brier score), and SHAP feature explanations.\n\nResultsInternal discrimination was higher for chronic (AUROC 0.736) than acute GVHD (0.624); chronic calibration was good (intercept +0.258, slope 1.073), whereas the acute model was underdispersed (slope 1.802). Externally, the chronic model retained modest, above-chance discrimination (AUROC 0.54-0.64), whereas acute performance fell toward chance (0.52-0.57). Calibration drifted unpredictably, overestimating risk in 9 of 10 evaluable cohort-outcome combinations (intercepts -0.78 to +0.15; slopes 0.12 to 1.98; Brier 0.23-0.27).\n\nDiscussionRoutine registry variables carry a transportable signal for chronic GVHD, but acute GVHD likely requires additional biological or clinical predictors. Neither the direction nor the magnitude of calibration drift could be anticipated from training performance.\n\nConclusionInternal performance does not guarantee external utility. Cohort-specific recalibration and routine calibration reporting are required before any clinical use; this study offers a reusable template for multi-cohort external evaluation of clinical prediction models.\n\nLay SummaryAfter a stem cell transplant from a donor, the donors immune cells can attack the patients body, a complication called graft-versus-host disease (GVHD). It can appear early (acute) or months later (chronic), and knowing who is at highest risk before transplant could help doctors plan prevention and follow-up. We built computer models that estimate GVHD risk using information routinely recorded at transplant, trained them on 2,509 patients from a large US transplant registry, and then tested them on six other groups totalling almost 15,000 patients, including patients from the United Arab Emirates and Jordan. The model for chronic GVHD kept a modest ability to separate higher-from lower-risk patients in every group, but the model for acute GVHD performed little better than chance outside the data it was built on. In almost every new group, both models overestimated how many patients would develop GVHD, by amounts that could not be predicted in advance. This shows that a model that works well where it was developed may not work elsewhere, and that its risk estimates must be checked and adjusted locally before it is ever used to guide care.",
  "abstract_shown": true,
  "affiliations": [
    "Cleveland Clinic Abu Dhabi"
  ],
  "article_type": "PUBLISHAHEADOFPRINT",
  "arxiv": null,
  "author_total": 16,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "N. Syed"
    },
    {
      "name": "N. Ahmed"
    },
    {
      "name": "M. Abuhaleeqa"
    },
    {
      "name": "F. M. Al Kaabi"
    },
    {
      "name": "A. Raza"
    },
    {
      "name": "A. Al Zaki"
    },
    {
      "name": "F. Sammour"
    },
    {
      "name": "Y. Alkhatib"
    },
    {
      "name": "D. Gopalakrishnan"
    },
    {
      "name": "I. Afrooz"
    },
    {
      "name": "M. Damlaj"
    },
    {
      "name": "H. Abu Jazar"
    },
    {
      "name": "H. Abdel-Razeq"
    },
    {
      "name": "K. Halahleh"
    },
    {
      "name": "M. Yaqub"
    },
    {
      "name": "S. Hashmi"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/ddpv80m7wyzn5.bib",
  "cited_by": 0,
  "doi": "10.64898/2026.06.14.26355639",
  "fulltext_url": "https://www.medrxiv.org/content/10.64898/2026.06.14.26355639v2.full",
  "id": "ddpv80m7wyzn5",
  "issns": [],
  "landing_url": "https://www.medrxiv.org/content/10.64898/2026.06.14.26355639v2",
  "language": null,
  "licence": "CC-BY-NC-ND",
  "licence_label": "CC BY-NC-ND",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by-nc-nd/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "medrxiv",
      "hematology"
    ],
    [
      "openalex",
      "2720|Hematopoietic Stem Cell Transplantation"
    ]
  ],
  "openalex": "W7165727209",
  "pdf_url": "https://www.medrxiv.org/content/10.64898/2026.06.14.26355639v2.full.pdf",
  "pmcid": null,
  "pmid": null,
  "published": "2026-06-14",
  "publisher": null,
  "ris": "https://research.draconitic.com/paper/ddpv80m7wyzn5.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:20:26Z",
      "native_id": "10.64898/2026.06.14.26355639",
      "source": "medrxiv",
      "url": "https://www.medrxiv.org/content/10.64898/2026.06.14.26355639v2"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "medrxiv:hematology",
      "subfield": "general"
    }
  ],
  "title": "External Evaluation and Calibration Drift of Explainable Machine Learning Models for Acute and Chronic GVHD Prediction After Allogeneic HSCT",
  "title_text": "External Evaluation and Calibration Drift of Explainable Machine Learning Models for Acute and Chronic GVHD Prediction After Allogeneic HSCT",
  "type": "preprint",
  "updated_at": "2026-10-30T12:20:26Z",
  "url": "https://research.draconitic.com/paper/ddpv80m7wyzn5",
  "venue": "medRxiv",
  "versions": []
}