Online Change-Point Detection in Linear Regression with Autoregressive Errors via Streaming Variational Bayes
Abstract
Large-scale streaming time-series regression requires methods that can detect structural changes while accounting for serially correlated errors and quantifying uncertainty about the current regime. We propose a streaming variational Bayes method for linear regression with autoregressive errors that combines online changepoint detection with sequential posterior inference. The proposed method processes observations in chronological mini-batches and uses a finite-mixture variational approximation to represent separate retention and reset configurations for the regression coefficients and innovation variance, while the autoregressive coefficients are shared across regimes and learned sequentially. This construction yields block-specific changepoint probabilities and posterior uncertainty summaries. Closed-form variational updates and mixture pruning enable scalable sequential inference without repeated full-data refits. In simulations, the proposed method maintains low empirical false-alarm rates under stable regimes, with posterior coverage improving as the sample size increases. Under repeated structural changes, it provides accurate type-specific changepoint detection, small changepoint location errors, and short detection delays relative to frequentist sequential monitoring procedures, while posterior coverage approaches nominal levels after an initial adaptation period. An application to high-frequency Bitcoin volatility data illustrates distinct adaptation of the regression and innovation-variance components while accounting for residual autoregressive dependence.
Related
- Renewable Online Expectile Regression for Heterogeneous Streaming Data with Abnormal Batches
- Scalable Sparse Autoregressive Variational Inference for Non-Gaussian Spatial Fields
- Discrete Diffusion Models via Evolving Variational Autoregressive Networks
- Estimation and Inference for One-pass Streaming Function-on-Function Regression
- Joint Conditional Maximum Likelihood Estimation of Beta Regression for Panel Data with Higher-Order Autoregressive Errors
BibTeX
@misc{jeong2026online,
title = {{Online Change-Point Detection in Linear Regression with Autoregressive Errors via Streaming Variational Bayes}},
author = {Yujin Jeong and Chaeeun Park and Sihyeon Pyeon and Seonghyun Jeong and Taeyoung Park},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.15309},
eprint = {2610.15309},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.15309},
}
RIS
TY - UNPB
TI - Online Change-Point Detection in Linear Regression with Autoregressive Errors via Streaming Variational Bayes
AU - Yujin Jeong
AU - Chaeeun Park
AU - Sihyeon Pyeon
AU - Seonghyun Jeong
AU - Taeyoung Park
PY - 2026
DA - 2026/10/11
PB - arXiv
DO - 10.48550/arxiv.2610.15309
UR - https://arxiv.org/abs/2610.15309
AB - Large-scale streaming time-series regression requires methods that can detect structural changes while accounting for serially correlated errors and quantifying uncertainty about the current regime. We propose a streaming variational Bayes method for linear regression with autoregressive errors that combines online changepoint detection with sequential posterior inference. The proposed method processes observations in chronological mini-batches and uses a finite-mixture variational approximation to represent separate retention and reset configurations for the regression coefficients and innovation variance, while the autoregressive coefficients are shared across regimes and learned sequentially. This construction yields block-specific changepoint probabilities and posterior uncertainty summaries. Closed-form variational updates and mixture pruning enable scalable sequential inference without repeated full-data refits. In simulations, the proposed method maintains low empirical false-alarm rates under stable regimes, with posterior coverage improving as the sample size increases. Under repeated structural changes, it provides accurate type-specific changepoint detection, small changepoint location errors, and short detection delays relative to frequentist sequential monitoring procedures, while posterior coverage approaches nominal levels after an initial adaptation period. An application to high-frequency Bitcoin volatility data illustrates distinct adaptation of the regression and innovation-variance components while accounting for residual autoregressive dependence.
ER -