Weak Factor Recovery in Sparse Bayesian Factor Models under Exchangeable Shrinkage Process Prior
Abstract
Sparse Bayesian factor models provide a flexible framework for learning low-dimensional latent structure in multivariate data, but inference on the number of active factors remains challenging when some factors are weak or highly sparse. We study weak factor recovery under a variance based exchangeable shrinkage process (ESP) prior. We derive the posterior factor activation mechanism and show that, conditional on the global and local shrinkage parameters, activation is governed by the standardised loading energy together with the ESP prior activation odds. This yields an explicit activation boundary and clarifies how signal strength, sparsity, the number of observed variables, and the truncation level affect recovery. Simulation experiments show a clear transition between shrinkage and recovery around this boundary and demonstrate that sparsity can substantially affect activation even when raw loading energy is held fixed. They further show that factor activation and recovery of the relative loading pattern across variables can behave differently. These results clarify when weak latent factors become difficult to distinguish from redundant components under ESP shrinkage.
Related
- dsp: An R Package for Bayesian Time Series Modeling with the Dynamic Shrinkage Process
- Bayesian Nonparametric Factor Analysis via Marginalized Dirichlet Process Column Clustering with Spike-and-Slab Sparsity
- Pathwise Shrinkage and Probabilistic Calibration of the Multiplicative Half-Cauchy Process
- Scalable Bayesian inference for time-discretised Markov jump processes via exchangeable particle Gibbs
- Semiparametric Bayesian structure learning of nonparanormal directed acyclic graphs with local--global shrinkage
BibTeX
@misc{grushanina2026weak,
title = {{Weak Factor Recovery in Sparse Bayesian Factor Models under Exchangeable Shrinkage Process Prior}},
author = {Margarita Grushanina},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.40491},
eprint = {2610.40491},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.40491},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Weak Factor Recovery in Sparse Bayesian Factor Models under Exchangeable Shrinkage Process Prior
AU - Margarita Grushanina
PY - 2026
DA - 2026/10/29
PB - arXiv
DO - 10.48550/arxiv.2610.40491
UR - https://arxiv.org/abs/2610.40491
AB - Sparse Bayesian factor models provide a flexible framework for learning low-dimensional latent structure in multivariate data, but inference on the number of active factors remains challenging when some factors are weak or highly sparse. We study weak factor recovery under a variance based exchangeable shrinkage process (ESP) prior. We derive the posterior factor activation mechanism and show that, conditional on the global and local shrinkage parameters, activation is governed by the standardised loading energy together with the ESP prior activation odds. This yields an explicit activation boundary and clarifies how signal strength, sparsity, the number of observed variables, and the truncation level affect recovery. Simulation experiments show a clear transition between shrinkage and recovery around this boundary and demonstrate that sparsity can substantially affect activation even when raw loading energy is held fixed. They further show that factor activation and recovery of the relative loading pattern across variables can behave differently. These results clarify when weak latent factors become difficult to distinguish from redundant components under ESP shrinkage.
ER -