Bayesian Treed Vecchia Gaussian Process Emulation via Sequential Monte Carlo
Abstract
Computer models (or simulators) are used in many scientific domains to understand and predict real-world processes, but they are expensive to run. One way to address this hurdle is to use Gaussian processes (GPs). For complex physical systems such as storm surge, simulator outputs often exhibit heterogeneous structures, and many nonstationary GP methods become impractical with several inputs and tens of thousands of runs. To address these issues, we combine the divide-and-conquer idea of treed GP models with Vecchia approximations in a Bayesian treed Vecchia GP (TVGP) model. The model uses the Bayesian classification and regression tree prior for random recursive partitioning of the input domain. Within each leaf, a Vecchia approximation allows efficient likelihood evaluation. For Bayesian inference, we develop a sequential Monte Carlo algorithm that explores tree space as an alternative to reversible-jump Markov chain Monte Carlo. The method is demonstrated on synthetic examples with two and ten inputs and on a storm-surge simulator with seven inputs and up to 50,649 training runs. TVGP has the smallest prediction error in both synthetic examples and with the larger storm-surge training set, although its predictive intervals undercover in the example with ten inputs and the storm-surge application.
Related
- Bayesian Emulation of Multi-fidelity Earth System Modelling Using Hierarchical Gaussian Processes
- Sequential sparse Gaussian process quantile regression
- Dirichlet Process Mixtures of Trees with Gaussian Process Splits: A Bayesian Nonparametric Framework with Posterior Contraction Rate
- Using Bayesian Sequential Logistic Regression to Model the Organ Transplant Selection Process
- Logistic Gaussian process density regression: a generalized Bayesian approach
BibTeX
@misc{ye2026bayesian,
title = {{Bayesian Treed Vecchia Gaussian Process Emulation via Sequential Monte Carlo}},
author = {Cong Ye and Pulong Ma},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.36770},
eprint = {2610.36770},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.36770},
}
RIS
TY - UNPB
TI - Bayesian Treed Vecchia Gaussian Process Emulation via Sequential Monte Carlo
AU - Cong Ye
AU - Pulong Ma
PY - 2026
DA - 2026/10/27
PB - arXiv
DO - 10.48550/arxiv.2610.36770
UR - https://arxiv.org/abs/2610.36770
AB - Computer models (or simulators) are used in many scientific domains to understand and predict real-world processes, but they are expensive to run. One way to address this hurdle is to use Gaussian processes (GPs). For complex physical systems such as storm surge, simulator outputs often exhibit heterogeneous structures, and many nonstationary GP methods become impractical with several inputs and tens of thousands of runs. To address these issues, we combine the divide-and-conquer idea of treed GP models with Vecchia approximations in a Bayesian treed Vecchia GP (TVGP) model. The model uses the Bayesian classification and regression tree prior for random recursive partitioning of the input domain. Within each leaf, a Vecchia approximation allows efficient likelihood evaluation. For Bayesian inference, we develop a sequential Monte Carlo algorithm that explores tree space as an alternative to reversible-jump Markov chain Monte Carlo. The method is demonstrated on synthetic examples with two and ten inputs and on a storm-surge simulator with seven inputs and up to 50,649 training runs. TVGP has the smallest prediction error in both synthetic examples and with the larger storm-surge training set, although its predictive intervals undercover in the example with ten inputs and the storm-surge application.
ER -