Predicting Backup Non-Compliance Using KPI-Derived Labels and Machine Learning: A Proof-of-Concept Study
Abstract
Ensuring backup compliance is essential for data protection and operational resilience in enterprise IT environments. This study proposes a KPI-aware machine learning approach combining weak supervision, rule-based labeling, and supervised learning to estimate KPI-derived backup non-compliance status. The approach was evaluated on 439 device instances with 33 features using an 80:20 stratified split, producing a test set of 88 instances comprising 86 non-compliant and only 2 compliant proxy labels, indicating extreme class imbalance. Proxy labels were generated from predefined KPI rules without manual annotation or independent compliance audits. Logistic Regression, Random Forest, and XGBoost were evaluated using AUC-PR, F1-score, recall, Brier score, and calibration analysis. Random Forest achieved the strongest comparative results, with an AUC-PR of 0.998, F1-score of 0.994, recall of 1.000, and the lowest Brier score of 0.014. However, calibration remains uncertain because only two compliant instances were available. Therefore, these results indicate preliminary feasibility for reproducing or estimating KPI-derived proxy labels and should not be interpreted as independent validation of real-world non-compliance detection. The approach provides a scalable basis for backup compliance monitoring and preliminary risk prioritization in enterprise IT systems.
Related
- Comparative Analysis of Machine Learning Algorithms for Predicting Difficulty Disengaging from Social Media Among Students
- A machine learning model for predicting ischemic and bleeding risk after percutaneous coronary intervention: Development and external validation
- Predicting freeway incident duration using machine learning
- Multiparametric MRI Radiomics and Machine Learning Framework for Predicting Treatment Response in Glioblastoma
- Predicting mental health risk in adolescents using interpretable machine learning: Evidence from SHAP analysis
BibTeX
@article{pane2026predicting,
title = {{Predicting Backup Non-Compliance Using KPI-Derived Labels and Machine Learning: A Proof-of-Concept Study}},
author = {Syafrial Fachri Pane and Muhammad Amran Hakim Siregar and Muhammad Qinthar Sabilla Almaliki and Andi Alamsyah Ode and Muhammad Baihaqi Siregar and Muhammad Arif Rivaldi and Raditya Rizki Raharja and Ahmad Rifky Ayala},
journal = {Journal of Information Systems and Informatics},
year = {2026},
month = oct,
doi = {10.63158/journalisi.v8i5.1846},
url = {https://doi.org/10.63158/journalisi.v8i5.1846},
note = {CC BY},
}
RIS
TY - JOUR
TI - Predicting Backup Non-Compliance Using KPI-Derived Labels and Machine Learning: A Proof-of-Concept Study
AU - Syafrial Fachri Pane
AU - Muhammad Amran Hakim Siregar
AU - Muhammad Qinthar Sabilla Almaliki
AU - Andi Alamsyah Ode
AU - Muhammad Baihaqi Siregar
AU - Muhammad Arif Rivaldi
AU - Raditya Rizki Raharja
AU - Ahmad Rifky Ayala
PY - 2026
DA - 2026/10/24
JO - Journal of Information Systems and Informatics
DO - 10.63158/journalisi.v8i5.1846
UR - https://doi.org/10.63158/journalisi.v8i5.1846
AB - Ensuring backup compliance is essential for data protection and operational resilience in enterprise IT environments. This study proposes a KPI-aware machine learning approach combining weak supervision, rule-based labeling, and supervised learning to estimate KPI-derived backup non-compliance status. The approach was evaluated on 439 device instances with 33 features using an 80:20 stratified split, producing a test set of 88 instances comprising 86 non-compliant and only 2 compliant proxy labels, indicating extreme class imbalance. Proxy labels were generated from predefined KPI rules without manual annotation or independent compliance audits. Logistic Regression, Random Forest, and XGBoost were evaluated using AUC-PR, F1-score, recall, Brier score, and calibration analysis. Random Forest achieved the strongest comparative results, with an AUC-PR of 0.998, F1-score of 0.994, recall of 1.000, and the lowest Brier score of 0.014. However, calibration remains uncertain because only two compliant instances were available. Therefore, these results indicate preliminary feasibility for reproducing or estimating KPI-derived proxy labels and should not be interpreted as independent validation of real-world non-compliance detection. The approach provides a scalable basis for backup compliance monitoring and preliminary risk prioritization in enterprise IT systems.
SN - 2656-5935
SN - 2656-4882
ER -