Three gaps for foundation models to address in satellite remote sensing of inland waters
Abstract
Long-term Earth observation of inland waters depends on continuity between satellite missions, adequate combinations of spectral, spatial and temporal resolution, and representative calibration and validation datasets. Discontinuities and trade-offs in these components constrain the records available for studying inland waters and their change. We examine three gaps affecting inland water remote sensing: a mission gap between comparable 300 m ocean colour observations from MERIS and OLCI during 2012–2016, a coverage gap in spectral, spatial and temporal sampling, and a generalisation gap when retrieval algorithm accuracy declines beyond bio-optical properties and atmospheric conditions represented during development. Foundation models (FMs) could help address these gaps by learning reusable representations from satellite archives before adaptation to a particular retrieval task. We hypothesise that relationships learned across overlapping satellite missions can support reconstruction of what a sensor would have measured during the mission gap, that combining complementary sensors can extend usable observation coverage, and that pretraining on satellite archives, which cover more water bodies and a wider range of bio-optical properties and atmospheric conditions than available field datasets, can improve retrieval algorithm generalisation. Testing these hypotheses requires criteria that define progress. We quantify the three gaps, define a progress criterion for each and assess 100 recent machine learning studies against the criteria. For the mission gap, three studies address continuity across sensor eras, and none recovers a record from a withheld mission period. For the coverage gap, 23 studies combine complementary observations, but only three test them on withheld water bodies or periods. For the generalisation gap, only seven studies withhold whole water bodies or later periods from all model development. Across all three gaps, none of the six studies that use pretraining compares it with the same architecture trained without pretraining on independent water bodies. The assumption common to all three hypotheses, that archive pretraining adds information beyond established methods, therefore remains untested. Applying the criteria to existing generic Earth observation FMs, then to FMs pretrained on inland waters, would determine which gaps pretraining can reduce.
Related
- Physics-constrained transfer learning with a spectral-fidelity-preserving model for satellite remote sensing applications
- Multi-source satellite remote sensing of harmful algal blooms in the East China Sea: cross-sensor comparison of GOCI, Sentinel-2 and Sentinel-3
- Unraveling nonlinear ecosystem water use efficiency dynamics and environmental drivers across Iran using remote sensing and XGBoost-SHAP
- Multi-source remote sensing reveals the key role of hydro-geomorphological variables in mapping small alpine peatlands
- Spatio-temporal assessment of mining-induced environmental changes using remote sensing: a case study of the Talcher Coalfield, Angul District, India
BibTeX
@misc{werther2026three,
title = {{Three gaps for foundation models to address in satellite remote sensing of inland waters}},
author = {Mortimer Werther and Stefan Simis and Jan Dirk Wegner and Daniel Odermatt},
howpublished = {EarthArXiv},
year = {2026},
month = oct,
doi = {10.31223/x5151t},
url = {https://eartharxiv.org/repository/view/15430/},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Three gaps for foundation models to address in satellite remote sensing of inland waters
AU - Mortimer Werther
AU - Stefan Simis
AU - Jan Dirk Wegner
AU - Daniel Odermatt
PY - 2026
DA - 2026/10/09
PB - EarthArXiv
DO - 10.31223/x5151t
UR - https://eartharxiv.org/repository/view/15430/
AB - Long-term Earth observation of inland waters depends on continuity between satellite missions, adequate combinations of spectral, spatial and temporal resolution, and representative calibration and validation datasets. Discontinuities and trade-offs in these components constrain the records available for studying inland waters and their change. We examine three gaps affecting inland water remote sensing: a mission gap between comparable 300 m ocean colour observations from MERIS and OLCI during 2012–2016, a coverage gap in spectral, spatial and temporal sampling, and a generalisation gap when retrieval algorithm accuracy declines beyond bio-optical properties and atmospheric conditions represented during development. Foundation models (FMs) could help address these gaps by learning reusable representations from satellite archives before adaptation to a particular retrieval task. We hypothesise that relationships learned across overlapping satellite missions can support reconstruction of what a sensor would have measured during the mission gap, that combining complementary sensors can extend usable observation coverage, and that pretraining on satellite archives, which cover more water bodies and a wider range of bio-optical properties and atmospheric conditions than available field datasets, can improve retrieval algorithm generalisation. Testing these hypotheses requires criteria that define progress. We quantify the three gaps, define a progress criterion for each and assess 100 recent machine learning studies against the criteria. For the mission gap, three studies address continuity across sensor eras, and none recovers a record from a withheld mission period. For the coverage gap, 23 studies combine complementary observations, but only three test them on withheld water bodies or periods. For the generalisation gap, only seven studies withhold whole water bodies or later periods from all model development. Across all three gaps, none of the six studies that use pretraining compares it with the same architecture trained without pretraining on independent water bodies. The assumption common to all three hypotheses, that archive pretraining adds information beyond established methods, therefore remains untested. Applying the criteria to existing generic Earth observation FMs, then to FMs pretrained on inland waters, would determine which gaps pretraining can reduce.
ER -