Skip to content
DraconiticResearch
Search Sources API
190,869 studies31 sourcesUpdated 5 min ago
PreprintarXiv licencearXiv

FREESIA: Covariance-Aware Posterior Transport for Expressive and Scalable Data Assimilation

Abstract

Data assimilation aims to infer the state of complex dynamical systems based on observational data. However, accurate inference of the multimodal posteriors induced by nonlinear or non-injective observation operators remains a key challenge under high-dimensional and sparse observation conditions. Ensemble filters scale to high dimensions but are confined by restrictive distributional assumptions, while training-free generative filters (e.g., EnSF, EnFF) alleviate this limitation but may introduce structural errors and hinder information propagation under sparse observations. To address these issues, we propose a training-free, asymptotically exact posterior transport method. Firstly, a covariance-aware posterior transport scheme is designed, which embeds the forecast cross-covariance into flow-based transport and accurately recovers unobserved states while preserving the non-Gaussian posterior structure. Furthermore, the method combines a tractable observation-adaptive proposal with posterior correction, ensuring accurate approximation of the nonlinear posterior distribution. Finally, we establish the corresponding posterior flow theory, from which the asymptotic exactness of the proposed method relative to finite-ensemble surrogates and the Wasserstein error bound are derived. Experiments on Double-Well, Lorenz-96, and Kolmogorov flow show that the proposed method captures complex posterior structure and remains accurate under sparse, nonlinear, and non-injective observations. In the sparse non-injective setting, it reduces RMSE by 56% relative to the best baseline.

Related

  1. From Variational Optimization to Flow-Based Transport: Posterior-Geometry Regularization for Ill-Conditioned Data Assimilation
    Siming Liang, Feng Bao, Hristo G. Chipilski +2
    arXivPreprintarXiv licenceFull textNumerical analysis & scientific computingarXiv
  2. Adaptive multi-resolution Gaussian processes: Scalable exact inference with naturally data-sparse covariance matrices
    Yanchuang Cao, Jun Liu, Tengchao Yu +1
    arXivPreprintarXiv licenceFull textStatisticsarXiv
  3. Covariance-Informed Ensemble Score Filtering: Embedding Localized Covariance Geometry into Score-Based Transport
    Siming Liang, Peter Jan van Leeuwen, Hristo G. Chipilski +3
    arXivPreprintarXiv licenceFull textAtmospheric science & meteorologyNumerical analysis & scientific computingarXiv
  4. Posterior sampling by source-space MCMC via prior-based few-step transport maps
    Hoang Phuc Hau Luu, Marcelo Hartmann, Zhongjian Wang
    arXivPreprintCC BY 4.0Full textStatisticsarXiv
  5. Fast and Scalable Multi-Agent Distribution Matching via Partitioned Optimal Transport
    Kooktae Lee, Ruchika Singh
    arXivPreprintarXiv licenceFull textOptimisation & controlarXiv
BibTeX
@misc{ni2026freesia,
  title = {{FREESIA: Covariance-Aware Posterior Transport for Expressive and Scalable Data Assimilation}},
  author = {Shiwei Ni and Yangwen Zhang and Hang Qi and Xiaofei Guan and Lili Ju},
  howpublished = {arXiv},
  year = {2026},
  month = sep,
  doi = {10.48550/arxiv.2609.25085},
  eprint = {2609.25085},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2609.25085},
}
RIS
TY  - UNPB
TI  - FREESIA: Covariance-Aware Posterior Transport for Expressive and Scalable Data Assimilation
AU  - Shiwei Ni
AU  - Yangwen Zhang
AU  - Hang Qi
AU  - Xiaofei Guan
AU  - Lili Ju
PY  - 2026
DA  - 2026/09/26
PB  - arXiv
DO  - 10.48550/arxiv.2609.25085
UR  - https://arxiv.org/abs/2609.25085
AB  - Data assimilation aims to infer the state of complex dynamical systems based on observational data. However, accurate inference of the multimodal posteriors induced by nonlinear or non-injective observation operators remains a key challenge under high-dimensional and sparse observation conditions. Ensemble filters scale to high dimensions but are confined by restrictive distributional assumptions, while training-free generative filters (e.g., EnSF, EnFF) alleviate this limitation but may introduce structural errors and hinder information propagation under sparse observations. To address these issues, we propose a training-free, asymptotically exact posterior transport method. Firstly, a covariance-aware posterior transport scheme is designed, which embeds the forecast cross-covariance into flow-based transport and accurately recovers unobserved states while preserving the non-Gaussian posterior structure. Furthermore, the method combines a tractable observation-adaptive proposal with posterior correction, ensuring accurate approximation of the nonlinear posterior distribution. Finally, we establish the corresponding posterior flow theory, from which the asymptotic exactness of the proposed method relative to finite-ensemble surrogates and the Wasserstein error bound are derived. Experiments on Double-Well, Lorenz-96, and Kolmogorov flow show that the proposed method captures complex posterior structure and remains accurate under sparse, nonlinear, and non-injective observations. In the sparse non-injective setting, it reduces RMSE by 56% relative to the best baseline.
ER  -