Simultaneous Latent Budget Trees for Stratified Classification
Abstract
In the era of Explainable Artificial Intelligence, there is a renewed focus on single trees for their ease of interpretation. This paper introduces Simultaneous Latent Budget Trees, a probabilistic machine learning framework for classification trees in the presence of a stratification factor such as a temporal, spatial, or demographic variable, acting as a control variable or potential confounder. Standard tree growth procedures are not designed to optimize a conditional split rule. A model-based split rule is proposed in which child nodes are interpreted as latent components of a simultaneous mixture model, such as the Simultaneous Latent Budget Model and its constrained versions, fitted to the parent node. Mixing parameters drive the observations, differently for each group, to the child nodes whereas latent budgets parameters update the response classes profile of each level of the control variable. Parameters are estimated by least squares considering a neural network perspective of the model. An informative tree structure can be interactively visualized with interpretation aids on the node and the paths, including visual pruning and decision tree selection procedure. Suitable measures are proposed to handle an unbalanced response class distribution. The proposed methodology is applied to investigate gender-related differences in disease progression of Amyotrophic Lateral Sclerosis. The SLBT library with the various tree-based algorithms is available in the linked GitHub repository.
Related
- Optimal Multi-way Decision Trees for Stratified Sampling in Online Controlled Experiments
- Prescribed and simultaneous failures of log-concavity in trees with perfect matchings
- Weighting-Based Strategies for Classification: Analysis and Local Peak Dynamics with CART Trees
- Neyman-Pearson Classification with Indecisions: Simultaneous Control of Selective Type I and Type II Errors
- A Moving-Horizon Approximate Branch-and-Reduce Method for Deep Classification Trees
BibTeX
@misc{buoncompagni2026simultaneous,
title = {{Simultaneous Latent Budget Trees for Stratified Classification}},
author = {Cristian Buoncompagni and Stefano Pellegrino and Giulia Vannucci and Raffaele Dubbioso and Roberta Siciliano},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2606.13295},
eprint = {2606.13295},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2606.13295},
}
RIS
TY - UNPB
TI - Simultaneous Latent Budget Trees for Stratified Classification
AU - Cristian Buoncompagni
AU - Stefano Pellegrino
AU - Giulia Vannucci
AU - Raffaele Dubbioso
AU - Roberta Siciliano
PY - 2026
DA - 2026/09/23
PB - arXiv
DO - 10.48550/arxiv.2606.13295
UR - https://arxiv.org/abs/2606.13295
AB - In the era of Explainable Artificial Intelligence, there is a renewed focus on single trees for their ease of interpretation. This paper introduces Simultaneous Latent Budget Trees, a probabilistic machine learning framework for classification trees in the presence of a stratification factor such as a temporal, spatial, or demographic variable, acting as a control variable or potential confounder. Standard tree growth procedures are not designed to optimize a conditional split rule. A model-based split rule is proposed in which child nodes are interpreted as latent components of a simultaneous mixture model, such as the Simultaneous Latent Budget Model and its constrained versions, fitted to the parent node. Mixing parameters drive the observations, differently for each group, to the child nodes whereas latent budgets parameters update the response classes profile of each level of the control variable. Parameters are estimated by least squares considering a neural network perspective of the model. An informative tree structure can be interactively visualized with interpretation aids on the node and the paths, including visual pruning and decision tree selection procedure. Suitable measures are proposed to handle an unbalanced response class distribution. The proposed methodology is applied to investigate gender-related differences in disease progression of Amyotrophic Lateral Sclerosis. The SLBT library with the various tree-based algorithms is available in the linked GitHub repository.
ER -