Structure-Preserving Dimension Reduction and Surrogates for Partially Linear Bayesian Inverse Problems
Abstract
Many Bayesian inverse problems are characterized by two parameter vectors with distinct roles. A medium property, operator coefficient, or geometry block enters the forward model nonlinearly, whereas a volumetric, initial condition, or boundary condition source enters linearly. General-purpose nonlinear surrogates must relearn this known source dependence from data and may not preserve the correct source scaling outside the training regime. We introduce a structure-preserving partially linear (SPPL) framework that constructs separate reduced spaces for outputs, (linearly appearing) sources, and (nonlinearly appearing) medium variables and represents the reduced forward map as an affine function of the retained source coordinates, with coefficients that depend on the medium variables. Here, "affine" refers to the retained, mean-centered source coordinates: the physical forward map remains linear in the source, while the affine offset is induced by the source-prior mean and vanishes when that mean is zero. The analysis first identifies the optimal blockwise ridge approximation and then derives the optimal affine-in-source approximation under independent medium and source priors. A direct decomposition of the forward error into output, source, medium, and surrogate contributions yields blockwise spectral criteria and prior-predictive expected-KL control. For a Gaussian source prior, the optimal affine-in-source approximation coincides with the optimal blockwise ridge approximation. In a coseismic numerical example, a three-model controlled ablation on common block-reduced coordinates separates the effects of coefficient-matrix supervision and structure-preserving affine-in-source parameterization. Reduced-space surrogate MCMC provides orders-of-magnitude online acceleration relative to high-fidelity posterior sampling.
Related
- A hyper-reduction strategy for elastoplastic hydro-mechanical problems in partially saturated soil
- Dimension reduction for characterizing sexual dimorphism in biomechanics of the temporomandibular joint
- Robust conditional dimension reduction for dissimilarity data
- Algebraic Dimension and Reduction of LVMB manifolds
- A capillary problem, its dimension reduction, and its phase-field approximation
BibTeX
@misc{zhang2026structurepreserving,
title = {{Structure-Preserving Dimension Reduction and Surrogates for Partially Linear Bayesian Inverse Problems}},
author = {Ziheng Zhang and Dingcheng Luo and Thomas O'Leary-Roseberry and Umberto Villa and Omar Ghattas},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.30306},
eprint = {2610.30306},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.30306},
}
RIS
TY - UNPB
TI - Structure-Preserving Dimension Reduction and Surrogates for Partially Linear Bayesian Inverse Problems
AU - Ziheng Zhang
AU - Dingcheng Luo
AU - Thomas O'Leary-Roseberry
AU - Umberto Villa
AU - Omar Ghattas
PY - 2026
DA - 2026/10/21
PB - arXiv
DO - 10.48550/arxiv.2610.30306
UR - https://arxiv.org/abs/2610.30306
AB - Many Bayesian inverse problems are characterized by two parameter vectors with distinct roles. A medium property, operator coefficient, or geometry block enters the forward model nonlinearly, whereas a volumetric, initial condition, or boundary condition source enters linearly. General-purpose nonlinear surrogates must relearn this known source dependence from data and may not preserve the correct source scaling outside the training regime. We introduce a structure-preserving partially linear (SPPL) framework that constructs separate reduced spaces for outputs, (linearly appearing) sources, and (nonlinearly appearing) medium variables and represents the reduced forward map as an affine function of the retained source coordinates, with coefficients that depend on the medium variables. Here, "affine" refers to the retained, mean-centered source coordinates: the physical forward map remains linear in the source, while the affine offset is induced by the source-prior mean and vanishes when that mean is zero. The analysis first identifies the optimal blockwise ridge approximation and then derives the optimal affine-in-source approximation under independent medium and source priors. A direct decomposition of the forward error into output, source, medium, and surrogate contributions yields blockwise spectral criteria and prior-predictive expected-KL control. For a Gaussian source prior, the optimal affine-in-source approximation coincides with the optimal blockwise ridge approximation. In a coseismic numerical example, a three-model controlled ablation on common block-reduced coordinates separates the effects of coefficient-matrix supervision and structure-preserving affine-in-source parameterization. Reduced-space surrogate MCMC provides orders-of-magnitude online acceleration relative to high-fidelity posterior sampling.
ER -