Predicting documented prior intentional self-harm in emergency departments: an interpretable gradient boosting approach using European injury surveillance data.
6 affiliations
- 1Department of Environment and Health (DAMSA), Italian National Institute of Health (ISS), Rome, Italy.
- 2Epidemiology Department, National Institute of Health Doctor Ricardo Jorge, Lisbon, Portugal.
- 3Environmental Health Institute (ISAMB), Faculty of Medicine, University of Lisbon, Lisbon, Portugal.
- 4Kuratorium für Verkehrssicherheit, Vienna, Austria.
- 5Consumer Safety Institute (VeiligheidNL), Amsterdam, Netherlands.
- 6Department of Social Work, School of Health Sciences, Hellenic Mediterranean University, Crete, Greece.
Abstract
Prior intentional self-harm history is the strongest predictor of completed suicide, yet this information frequently goes uncommunicated during emergency department (ED) presentations. We developed an interpretable gradient boosting model (XGBoost) to predict whether a patient's record in the European Injury Database (EU-IDB) carries a documented prior self-harm flag, using injury characteristics, demographics, and clinical features available at ED attendance. The raw dataset comprised 62,467 attendances for intentional self-harm from 18 countries (2008-2023), with 86.2% of outcomes coded Unknown. Formal missingness analysis showed that observed outcome missingness was overwhelmingly explained by country membership (country alone: pseudo-R2 = 0.537, AUC = 0.948) and that documentation was positive-biased: across countries, the sparser the documentation, the higher the positivity among documented records (Spearman ρ = 0.882). A three-step "Third Way" strategy excluded three countries with structurally absent outcome protocols and defined the target as a documented positive flag vs. its absence, yielding an analytical dataset of 26,554 records (prevalence 13.7%), three times larger than the complete-case alternative. XGBoost achieved AUC-ROC = 0.800 (95% CI 0.783-0.816), AUC-PR = 0.380, and Brier score = 0.100, significantly outperforming logistic regression (DeLong p = 3.93 × 10-10). At the optimised threshold (0.080), sensitivity was 80.8%, specificity 62.8%, NPV 95.4%. A time-zero model restricted to variables available at triage achieved AUC-ROC = 0.762 (0.745-0.780) and retained its advantage over the linear baseline (0.729, 0.712-0.746). SHAP analysis identified proximal risk factor documentation, place of occurrence, and patient age as dominant predictors, and a sensitivity analysis excluding the ProximalRiskFactor variable (AUC-ROC = 0.765) confirmed robustness to a potentially circular feature. A country prediction test (95.3% accuracy, 14.3× chance) quantified substantial implicit geographic encoding in the clinical features, offering a plausible explanation for the gap between test-set AUC-ROC (0.800), temporal validation (0.674) and group-aware cross-validation (0.658). Country-stratified assessment revealed adequate calibration in most settings but miscalibration in low-volume countries, and fairness analysis identified lower sensitivity in older adults (68.0%; AUC-ROC 0.722, 95% CI 0.617-0.822) as a critical limitation. This model could serve as a decision support layer within ED workflows, but requires local validation, country-specific recalibration, and embedding within structured post-identification care pathways before deployment.
Related
- Repeated Internal Validation and Interpretation of Models Predicting Surgery Documented at a Study Institution Within 90 Days After Acute Knee Trauma: A Secondary Analysis
- The COVID-19 Trajectory in Israel: A Comprehensive Analysis of National Surveillance Data on Documented Infections, Test Positivity, and Vaccine-Effectiveness Estimates
- Gout-Related Chinese Herbal Medicine/Chinese Patent Medicine Exposure and Documented Refractory Gout Status: A Retrospective Real-World Cohort Study of Outcome Completeness and Surveillance Intensity
- Artificial intelligence approach for predicting suicide-related behaviour in emergency departments
- Shall we repeat? Predicting the necessity to repeat blood testing in pediatric emergency departments of laboratory tests previously performed in the community using a machine learning model
BibTeX
@article{giustini2026predicting,
title = {{Predicting documented prior intentional self-harm in emergency departments: an interpretable gradient boosting approach using European injury surveillance data.}},
author = {Marco Giustini and Alessio Pitidis and Cecilia Fazio and Tatiana Alves and Tabea Fian and Huib Valkenberg and Susanne Nijman and Maria Papadakaki and Anna Carannante},
journal = {Frontiers in digital health},
year = {2026},
month = oct,
doi = {10.3389/fdgth.2026.1964834},
url = {https://europepmc.org/article/MED/42952585},
note = {CC BY},
}
RIS
TY - JOUR
TI - Predicting documented prior intentional self-harm in emergency departments: an interpretable gradient boosting approach using European injury surveillance data.
AU - Marco Giustini
AU - Alessio Pitidis
AU - Cecilia Fazio
AU - Tatiana Alves
AU - Tabea Fian
AU - Huib Valkenberg
AU - Susanne Nijman
AU - Maria Papadakaki
AU - Anna Carannante
PY - 2026
DA - 2026/10/14
JO - Frontiers in digital health
DO - 10.3389/fdgth.2026.1964834
UR - https://europepmc.org/article/MED/42952585
AB - Prior intentional self-harm history is the strongest predictor of completed suicide, yet this information frequently goes uncommunicated during emergency department (ED) presentations. We developed an interpretable gradient boosting model (XGBoost) to predict whether a patient's record in the European Injury Database (EU-IDB) carries a documented prior self-harm flag, using injury characteristics, demographics, and clinical features available at ED attendance. The raw dataset comprised 62,467 attendances for intentional self-harm from 18 countries (2008-2023), with 86.2% of outcomes coded Unknown. Formal missingness analysis showed that observed outcome missingness was overwhelmingly explained by country membership (country alone: pseudo-R2 = 0.537, AUC = 0.948) and that documentation was positive-biased: across countries, the sparser the documentation, the higher the positivity among documented records (Spearman ρ = 0.882). A three-step "Third Way" strategy excluded three countries with structurally absent outcome protocols and defined the target as a documented positive flag vs. its absence, yielding an analytical dataset of 26,554 records (prevalence 13.7%), three times larger than the complete-case alternative. XGBoost achieved AUC-ROC = 0.800 (95% CI 0.783-0.816), AUC-PR = 0.380, and Brier score = 0.100, significantly outperforming logistic regression (DeLong p = 3.93 × 10-10). At the optimised threshold (0.080), sensitivity was 80.8%, specificity 62.8%, NPV 95.4%. A time-zero model restricted to variables available at triage achieved AUC-ROC = 0.762 (0.745-0.780) and retained its advantage over the linear baseline (0.729, 0.712-0.746). SHAP analysis identified proximal risk factor documentation, place of occurrence, and patient age as dominant predictors, and a sensitivity analysis excluding the ProximalRiskFactor variable (AUC-ROC = 0.765) confirmed robustness to a potentially circular feature. A country prediction test (95.3% accuracy, 14.3× chance) quantified substantial implicit geographic encoding in the clinical features, offering a plausible explanation for the gap between test-set AUC-ROC (0.800), temporal validation (0.674) and group-aware cross-validation (0.658). Country-stratified assessment revealed adequate calibration in most settings but miscalibration in low-volume countries, and fairness analysis identified lower sensitivity in older adults (68.0%; AUC-ROC 0.722, 95% CI 0.617-0.822) as a critical limitation. This model could serve as a decision support layer within ED workflows, but requires local validation, country-specific recalibration, and embedding within structured post-identification care pathways before deployment.
SN - 2673-253X
ER -