Variational Bayes for Variable Selection with Adaptive Sharing across Populations and Responses
Abstract
We propose a variational Bayesian framework for variable selection with multiple responses across heterogeneous populations. The prior dependence among the inclusion indicators allows variable-selection information to be shared at different levels across populations and responses, while regression coefficients remain population- and response-specific. When the appropriate sharing structure is unknown, a data-driven rule adaptively determines the scope of information sharing from marginal association evidence. The resulting variational algorithm is computationally scalable and can be implemented using either individual-level or summary data. Under regularity conditions, we establish selection consistency and convergence properties of the variational parameters at fixed iterations of the algorithm for fixed dimension case. In high dimensions, we establish model-selection consistency and coefficient contraction in both ℓ1 and ℓ2 norms. Simulation studies show competitive variable selection performance and demonstrate the potential gains from joint analysis. We further illustrate the summary-data implementation using genome-wide association summary statistics from the 2021 Global Lipids Genetics Consortium study for four lipid traits across five populations.
Related
- Scalable Variable Selection under Predictor Dependence with Adaptive Virtual Dummies
- L-PASSO: Adaptive Log-penalized Variable Selector, with Sparse Selection and Robustness to the Pilot Estimator
- A variational model with finite carrying capacity for segregated multi-species populations in the whole Euclidean space
- Amortized Structured Stochastic Variational Inference for Gaussian Process Latent Variable Models
- High-Order Variable-Scaled Energetic Variational Neural Networks for Phase-Field Gradient Flows
BibTeX
@misc{yang2026variational,
title = {{Variational Bayes for Variable Selection with Adaptive Sharing across Populations and Responses}},
author = {Yuehan Yang and Pengfei Chen and Fan Yang and Chong You},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.39677},
eprint = {2610.39677},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.39677},
}
RIS
TY - UNPB
TI - Variational Bayes for Variable Selection with Adaptive Sharing across Populations and Responses
AU - Yuehan Yang
AU - Pengfei Chen
AU - Fan Yang
AU - Chong You
PY - 2026
DA - 2026/10/29
PB - arXiv
DO - 10.48550/arxiv.2610.39677
UR - https://arxiv.org/abs/2610.39677
AB - We propose a variational Bayesian framework for variable selection with multiple responses across heterogeneous populations. The prior dependence among the inclusion indicators allows variable-selection information to be shared at different levels across populations and responses, while regression coefficients remain population- and response-specific. When the appropriate sharing structure is unknown, a data-driven rule adaptively determines the scope of information sharing from marginal association evidence. The resulting variational algorithm is computationally scalable and can be implemented using either individual-level or summary data. Under regularity conditions, we establish selection consistency and convergence properties of the variational parameters at fixed iterations of the algorithm for fixed dimension case. In high dimensions, we establish model-selection consistency and coefficient contraction in both ℓ_1 and ℓ_2 norms. Simulation studies show competitive variable selection performance and demonstrate the potential gains from joint analysis. We further illustrate the summary-data implementation using genome-wide association summary statistics from the 2021 Global Lipids Genetics Consortium study for four lipid traits across five populations.
ER -