UpStream: A Modular, Metadata-First Architecture for Environmental Sensing During Intensive Observation Periods
Abstract
Campaign-scale environmental sensing produces heterogeneous, high-frequency datasets that strain file- and portal-centric workflows and impede decision support. This paper presents UpStream, an API-first, metadata-supported, modular prototype for campaign-scale environmental sensor data. Co-designed with the SNIFFER air-quality laboratory, UpStream treats campaigns as first-class entities with explicit identity, scope, and governance, embeds metadata capture at ingestion, and provides selective, query-mediated access to high-resolution observations under concurrent use. We evaluate the architecture through three field deployments, a mobile PTR-MS laboratory and a stationary eddy-covariance flux tower, plus a remote, pull-based deployment in Alaska, showing that heterogeneous, evolving instrument outputs are absorbed without schema redesign while campaign boundaries, selective access, and metadata persist throughout the data lifecycle. We distill these results into transferable architectural principles for campaign-scale environmental sensing systems supporting decision support: modular service separation, flexible schema design, metadata-at-ingestion, query-mediated access, and federation designed in from the start.
Related
- Investigating variability and uncertainty in upstream methane emissions intensity estimates of Western Canadian oil and gas production
- Clear‐Air Turbulence Upstream of a Hydraulic Jump Leading to a Helicopter Accident—A Large Eddy Simulation
- Measurement-Informed Methane Inventories for Colorado’s Upstream Oil and Gas Sector: Two Independent Modeling Approaches
- Successful Rescue of a Juvenile Humpback Whale (Megaptera novaeangliae) Trapped Upstream of the Rance Tidal Power Station, Brittany, France
- Reconstructing Significant Wave Height Fields from Sparse Observations Using Virtual Observation Augmentation
BibTeX
@misc{mobley2026upstream,
title = {{UpStream: A Modular, Metadata-First Architecture for Environmental Sensing During Intensive Observation Periods}},
author = {William Mobley and Linchao Luo and Maximiliano Osorio and Vladislav Krendelev and Chou-Hsien Lin and Keuntaek Kim and Suzanne A. Pierce and Evelyn Deveraux and Chih-Shen Cheng and Pawel Misztal},
howpublished = {EarthArXiv},
year = {2026},
month = nov,
doi = {10.31223/x55r76},
url = {https://eartharxiv.org/repository/view/15966/},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - UpStream: A Modular, Metadata-First Architecture for Environmental Sensing During Intensive Observation Periods
AU - William Mobley
AU - Linchao Luo
AU - Maximiliano Osorio
AU - Vladislav Krendelev
AU - Chou-Hsien Lin
AU - Keuntaek Kim
AU - Suzanne A. Pierce
AU - Evelyn Deveraux
AU - Chih-Shen Cheng
AU - Pawel Misztal
PY - 2026
DA - 2026/11/04
PB - EarthArXiv
DO - 10.31223/x55r76
UR - https://eartharxiv.org/repository/view/15966/
AB - Campaign-scale environmental sensing produces heterogeneous, high-frequency datasets that strain file- and portal-centric workflows and impede decision support. This paper presents UpStream, an API-first, metadata-supported, modular prototype for campaign-scale environmental sensor data. Co-designed with the SNIFFER air-quality laboratory, UpStream treats campaigns as first-class entities with explicit identity, scope, and governance, embeds metadata capture at ingestion, and provides selective, query-mediated access to high-resolution observations under concurrent use. We evaluate the architecture through three field deployments, a mobile PTR-MS laboratory and a stationary eddy-covariance flux tower, plus a remote, pull-based deployment in Alaska, showing that heterogeneous, evolving instrument outputs are absorbed without schema redesign while campaign boundaries, selective access, and metadata persist throughout the data lifecycle. We distill these results into transferable architectural principles for campaign-scale environmental sensing systems supporting decision support: modular service separation, flexible schema design, metadata-at-ingestion, query-mediated access, and federation designed in from the start.
ER -