A Three-Stage PCA Procedure for Sequentially Arriving High-Dimensional Data
Abstract
We develop a three-stage adaptive procedure for principal component analysis (PCA) when high-dimensional observations are collected sequentially and additional sampling incurs a cost. The procedure balances PCA compression loss against sampling cost while selecting the retained dimension through a prescribed explained-variance criterion. Starting from a pilot sample, an intermediate stage updates the PCA quantities before determining the final sample size, thereby avoiding reliance on unknown population eigenvalues. Under suitable regularity conditions, we establish both first- and second-order efficiency relative to the population oracle. Comparison with the corresponding two-stage rule shows that the additional recalibration yields sharper second-order control and reduces the influence of the pilot stage on the final sampling decision. The theory allows the ambient dimension to exceed the sample size under appropriate covariance and spectral conditions. Simulation studies demonstrate the strong finite-sample performance of the procedure across increasing dimensions and several dense covariance structures. As a real-data application, we conduct a retrospective study of gene-expression data from 32 cancer-type cohorts in The Cancer Genome Atlas, illustrating both cost-effective early stopping and settings in which additional observations are recommended.
Related
- Scaffold Write Debug: A Three-Stage Approach to Proof Writing in Introductory Real Analysis
- A Unified Three-Stage Weighting Framework for Causal Inference and Mediation Analysis under Case-Control Sampling
- Three Case Studies of Two-stage MCMC for Fast Bayesian Inference of Large Spatio-temporal Data
- Wavenumber-explicit stability of three-dimensional Cartesian UPMLs with piecewise-constant profiles for Helmholtz and Maxwell equations
- Three-dimensional noncommutative Fano minifolds
BibTeX
@misc{sarkar2026threestage,
title = {{A Three-Stage PCA Procedure for Sequentially Arriving High-Dimensional Data}},
author = {Partha Sarkar and Sairam Rayapolu and Bhargab Chattopadhyay},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.38681},
eprint = {2609.38681},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.38681},
}
RIS
TY - UNPB
TI - A Three-Stage PCA Procedure for Sequentially Arriving High-Dimensional Data
AU - Partha Sarkar
AU - Sairam Rayapolu
AU - Bhargab Chattopadhyay
PY - 2026
DA - 2026/09/30
PB - arXiv
DO - 10.48550/arxiv.2609.38681
UR - https://arxiv.org/abs/2609.38681
AB - We develop a three-stage adaptive procedure for principal component analysis (PCA) when high-dimensional observations are collected sequentially and additional sampling incurs a cost. The procedure balances PCA compression loss against sampling cost while selecting the retained dimension through a prescribed explained-variance criterion. Starting from a pilot sample, an intermediate stage updates the PCA quantities before determining the final sample size, thereby avoiding reliance on unknown population eigenvalues. Under suitable regularity conditions, we establish both first- and second-order efficiency relative to the population oracle. Comparison with the corresponding two-stage rule shows that the additional recalibration yields sharper second-order control and reduces the influence of the pilot stage on the final sampling decision. The theory allows the ambient dimension to exceed the sample size under appropriate covariance and spectral conditions. Simulation studies demonstrate the strong finite-sample performance of the procedure across increasing dimensions and several dense covariance structures. As a real-data application, we conduct a retrospective study of gene-expression data from 32 cancer-type cohorts in The Cancer Genome Atlas, illustrating both cost-effective early stopping and settings in which additional observations are recommended.
ER -