Penalized Likelihood Inference in Highly Multivariate Sparse Spectral Graphical Gaussian Processes
Abstract
We develop a penalized likelihood inference approach for highly multivariate Gaussian stochastic processes. Since zeros in the inverse cross-spectral density encode process-level conditional independence, sparse modeling of this object provides a natural route to scalable inference in the highly multivariate case. We introduce a latent variable representation which, combined with random Fourier features, yields a stochastic approximation expectation--maximization algorithm for penalized maximum likelihood estimation of a sparse inverse cross-spectral density matrix under a graphical LASSO penalty. The augmentation is crucial because sparsity is present in the inverse spectral density of the latent variable, whereas the marginal inverse covariance remains dense in the presence of a spatial nugget. Our frequency domain formulation enables joint penalized likelihood estimation of process-specific spatial covariance parameters and sparse process-level conditional dependence without requiring a pre-specified reference set of locations. The method is demonstrated on both synthetic and the MERRA-2 aerosol reanalysis data sets, yielding benefit over existing alternatives, especially for prediction at unobserved locations under spatial misalignment.
Related
- Penalized Maximum Likelihood Inference of Core-Periphery Networks
- A Formal Graphical Inference Framework for Combining Effect Size with Statistical Significance: Application to Multivariate and Functional Linear Models
- Bigraphical Matérn-Whittle (BMW) Processes for Fast Inference of Big Multivariate Spatial Data on General Domains
- Strong Approximations for Multivariate Integrated Empirical Processes: Two-Sample Testing, Change-Point Detection, and Inference with Estimated Parameters
- Consistency of penalized maximum likelihood estimation for multidimensional change-in-velocity detection
BibTeX
@misc{chen2026penalized,
title = {{Penalized Likelihood Inference in Highly Multivariate Sparse Spectral Graphical Gaussian Processes}},
author = {Bo-yu Chen and Drew Yarger and Anindya Bhadra},
howpublished = {arXiv},
year = {2026},
month = nov,
doi = {10.48550/arxiv.2611.00467},
eprint = {2611.00467},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2611.00467},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Penalized Likelihood Inference in Highly Multivariate Sparse Spectral Graphical Gaussian Processes
AU - Bo-yu Chen
AU - Drew Yarger
AU - Anindya Bhadra
PY - 2026
DA - 2026/11/01
PB - arXiv
DO - 10.48550/arxiv.2611.00467
UR - https://arxiv.org/abs/2611.00467
AB - We develop a penalized likelihood inference approach for highly multivariate Gaussian stochastic processes. Since zeros in the inverse cross-spectral density encode process-level conditional independence, sparse modeling of this object provides a natural route to scalable inference in the highly multivariate case. We introduce a latent variable representation which, combined with random Fourier features, yields a stochastic approximation expectation--maximization algorithm for penalized maximum likelihood estimation of a sparse inverse cross-spectral density matrix under a graphical LASSO penalty. The augmentation is crucial because sparsity is present in the inverse spectral density of the latent variable, whereas the marginal inverse covariance remains dense in the presence of a spatial nugget. Our frequency domain formulation enables joint penalized likelihood estimation of process-specific spatial covariance parameters and sparse process-level conditional dependence without requiring a pre-specified reference set of locations. The method is demonstrated on both synthetic and the MERRA-2 aerosol reanalysis data sets, yielding benefit over existing alternatives, especially for prediction at unobserved locations under spatial misalignment.
ER -