Rip current detection in nearshore areas through UAV video analysis using optical flow and almost local-isometric embedding techniques on the sphere
- 1Department of Mathematics, University of Miami, Coral Gables, Florida, United States of America.
- 2Department of Earth and Environment, Florida International University, Miami, Florida, United States of America.
- 3Department of Electrical and Computer Engineering, University of Miami, Coral Gables, Florida, United States of America.
Abstract
Rip currents cause most surf-beach lifeguard rescues and most beach drowning incidents, yet automated detection relies on costly instrumentation that scales poorly across the many beaches that lack lifeguards. We propose an end-to-end pipeline producing pixel-level rip-current likelihood maps directly from raw unmanned aerial vehicle (UAV) video without manual ground-control points — to our knowledge the first to do so from uncalibrated drone video, prior automated approaches operating at video-clip granularity or requiring surveyed camera installations. The pipeline composes (i) dense optical-flow estimation with five classical algorithm variants; (ii) a sphere-aware projection mapping pixel coordinates to local-isometric ground coordinates, with a tilt-aware Jacobian correction of per-pixel velocity; (iii) a CNN six-class scene parser (sky/sea/land/foam/structure/void), trained on frames verified by dense pixel-matching to contain no extraction from either evaluation video; (iv) a per-pixel temporal accumulator flagging pixels whose flow direction agrees with the locally-estimated offshore direction within ±90∘ — the physical boundary of seaward-directed flow, shown robust in an 18-scene sensitivity sweep; and (v) post-processing by Gaussian smoothing (σ=25 px) and a normalized cross-algorithm ensemble. We evaluate on two UAV-captured rip-current videos at Palm Beach and Haulover Park, Florida, annotated by consensus among three coastal-science domain experts. At the physically-neutral T=90∘ default the framework attains precision-recall AUC 0.636 at Palm Beach and 0.660 at Haulover; per-scene selection — of the angular tolerance, ensemble membership, mixing weight, sphere tilt, and which modules are engaged — against the same expert annotation used for evaluation raises these to 0.7066 and 0.7040, reported as an optimistic upper bound rather than an expected-performance estimate. We release the source code, the trained sea-mask refiner, a YOLOv8m-seg deep-learning baseline, and the evaluation scripts. Evaluation is limited to these two expert-annotated scenes, and the method requires visible surface tracers (foam, dye, or sediment fronts) advected by the current.
Related
- Enzymatic browning in fresh-cut fruits and vegetables: a comprehensive review of biochemical etiologies, detection techniques, and control strategies.
- Assessing the Potential Distribution of Eriocheir sinensis Under Climate Change: Regional Contrasts and Spatial Mismatches in Terrestrial and Nearshore Suitability
- High cryptic diversity of invertebrates in varying nearshore habitats of the Beaufort Sea
- Design of a comprehensive protection algorithm for fault detection, classification, and location in high voltage direct current transmission lines connected to wind farms based on local terminal measurements
- Unchanged H-reflex during a sustained isometric submaximal plantar flexion performed with an EMG biofeedback
BibTeX
@article{yang2026current,
title = {{Rip current detection in nearshore areas through UAV video analysis using optical flow and almost local-isometric embedding techniques on the sphere}},
author = {Kaiqi Yang and Stephen B Leatherman and Anchen Sun},
journal = {PLOS One},
year = {2026},
month = oct,
doi = {10.1371/journal.pone.0360672},
url = {https://doi.org/10.1371/journal.pone.0360672},
note = {CC BY},
}
RIS
TY - JOUR
TI - Rip current detection in nearshore areas through UAV video analysis using optical flow and almost local-isometric embedding techniques on the sphere
AU - Kaiqi Yang
AU - Stephen B Leatherman
AU - Anchen Sun
PY - 2026
DA - 2026/10/29
JO - PLOS One
DO - 10.1371/journal.pone.0360672
UR - https://doi.org/10.1371/journal.pone.0360672
AB - Rip currents cause most surf-beach lifeguard rescues and most beach drowning incidents, yet automated detection relies on costly instrumentation that scales poorly across the many beaches that lack lifeguards. We propose an end-to-end pipeline producing pixel-level rip-current likelihood maps directly from raw unmanned aerial vehicle (UAV) video without manual ground-control points — to our knowledge the first to do so from uncalibrated drone video, prior automated approaches operating at video-clip granularity or requiring surveyed camera installations. The pipeline composes (i) dense optical-flow estimation with five classical algorithm variants; (ii) a sphere-aware projection mapping pixel coordinates to local-isometric ground coordinates, with a tilt-aware Jacobian correction of per-pixel velocity; (iii) a CNN six-class scene parser (sky/sea/land/foam/structure/void), trained on frames verified by dense pixel-matching to contain no extraction from either evaluation video; (iv) a per-pixel temporal accumulator flagging pixels whose flow direction agrees with the locally-estimated offshore direction within ±90∘ — the physical boundary of seaward-directed flow, shown robust in an 18-scene sensitivity sweep; and (v) post-processing by Gaussian smoothing (σ=25 px) and a normalized cross-algorithm ensemble. We evaluate on two UAV-captured rip-current videos at Palm Beach and Haulover Park, Florida, annotated by consensus among three coastal-science domain experts. At the physically-neutral T=90∘ default the framework attains precision-recall AUC 0.636 at Palm Beach and 0.660 at Haulover; per-scene selection — of the angular tolerance, ensemble membership, mixing weight, sphere tilt, and which modules are engaged — against the same expert annotation used for evaluation raises these to 0.7066 and 0.7040, reported as an optimistic upper bound rather than an expected-performance estimate. We release the source code, the trained sea-mask refiner, a YOLOv8m-seg deep-learning baseline, and the evaluation scripts. Evaluation is limited to these two expert-annotated scenes, and the method requires visible surface tracers (foam, dye, or sediment fronts) advected by the current.
SN - 1932-6203
ER -