Mitigating incoherent excess variance in high-redshift 21-cm observations with multi-output cross Gaussian process regression
Abstract
Systematic effects that limit the achievable sensitivity of current low-frequency radio telescopes to the 21-cm signal are among the foremost challenges in observational 21-cm cosmology. The standard approach to retrieving the 21-cm signal from radio interferometric data separates it from bright astrophysical foregrounds by exploiting their spectrally smooth nature, in contrast to the finer spectral structure of the 21-cm signal. Contaminants exhibiting rapid frequency fluctuations, on the other hand, are difficult to separate from the 21-cm signal using standard techniques, and the power from these contaminants contributes to low-level systematics that can limit our ability to detect the 21-cm signal. Many of these low-level systematics are incoherent across multiple nights of observation, resulting in an incoherent excess variance above the thermal noise sensitivity of the instrument. In this paper, we develop a method called cross-GPR (cross covariance Gaussian process regression) that exploits the incoherence of these systematics to separate them from the 21-cm signal, which remains coherent across multiple nights of observation. We first develop and demonstrate the technique on synthetic signals in a general setting, and then apply it to gridded interferometric visibility cubes. We perform realistic simulations of visibility cubes containing foregrounds, 21-cm signal, noise, and incoherent systematics. The simulations show that the method can successfully separate and subtract incoherent contributions to the excess variance, and its advantages over standard techniques become more evident when the spectral behavior of the contaminants resembles that of the 21-cm signal. Simulations performed on a variety of 21-cm signal shapes also reveal that the cross-GPR approach can subtract incoherent contributions to the excess variance, without suppressing the 21-cm signal.
Related
- The Impact of Cosmic Variance and Satellites on JWST Clustering Measurements at redshift ≈6
- New constraints on holographic dark energy with high-redshift galaxy observations from JWST
- Inferring magnetic field strengths in high-redshift lensing galaxies from Faraday rotation measure observations
- Modeling CO Line Luminosity with FIRE simulations: II. Comparison With Observations, CO Luminosity Functions and Redshift Evolution
- Calibration requirements for Epoch of Reionization 21-cm signal observations - V. Bias and variance in the cylindrical power spectrum from uGMRT Band 3 observations of the ELAIS-N1 field
BibTeX
@article{munshi2026mitigating,
title = {{Mitigating incoherent excess variance in high-redshift 21-cm observations with multi-output cross Gaussian process regression}},
author = {S Munshi and L.V.E Koopmans and F.G Mertens and A.R Offringa and S.A Brackenhoff and E Ceccotti and J.K Chege and L.Y Gao and S Ghosh and M Mevius and S Zaroubi},
journal = {Astronomy \& Astrophysics - A\&A},
year = {2026},
month = oct,
doi = {10.1051/0004-6361/202556785},
eprint = {2508.08235},
archivePrefix = {arXiv},
url = {https://hal.science/hal-05234044v1},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - Mitigating incoherent excess variance in high-redshift 21-cm observations with multi-output cross Gaussian process regression
AU - S Munshi
AU - L.V.E Koopmans
AU - F.G Mertens
AU - A.R Offringa
AU - S.A Brackenhoff
AU - E Ceccotti
AU - J.K Chege
AU - L.Y Gao
AU - S Ghosh
AU - M Mevius
AU - S Zaroubi
PY - 2026
DA - 2026/10/09
JO - Astronomy & Astrophysics - A&A
DO - 10.1051/0004-6361/202556785
UR - https://hal.science/hal-05234044v1
AB - Systematic effects that limit the achievable sensitivity of current low-frequency radio telescopes to the 21-cm signal are among the foremost challenges in observational 21-cm cosmology. The standard approach to retrieving the 21-cm signal from radio interferometric data separates it from bright astrophysical foregrounds by exploiting their spectrally smooth nature, in contrast to the finer spectral structure of the 21-cm signal. Contaminants exhibiting rapid frequency fluctuations, on the other hand, are difficult to separate from the 21-cm signal using standard techniques, and the power from these contaminants contributes to low-level systematics that can limit our ability to detect the 21-cm signal. Many of these low-level systematics are incoherent across multiple nights of observation, resulting in an incoherent excess variance above the thermal noise sensitivity of the instrument. In this paper, we develop a method called cross-GPR (cross covariance Gaussian process regression) that exploits the incoherence of these systematics to separate them from the 21-cm signal, which remains coherent across multiple nights of observation. We first develop and demonstrate the technique on synthetic signals in a general setting, and then apply it to gridded interferometric visibility cubes. We perform realistic simulations of visibility cubes containing foregrounds, 21-cm signal, noise, and incoherent systematics. The simulations show that the method can successfully separate and subtract incoherent contributions to the excess variance, and its advantages over standard techniques become more evident when the spectral behavior of the contaminants resembles that of the 21-cm signal. Simulations performed on a variety of 21-cm signal shapes also reveal that the cross-GPR approach can subtract incoherent contributions to the excess variance, without suppressing the 21-cm signal.
SN - 0004-6361
SN - 1432-0746
ER -