Confidence Filtering in Video-Based Gait Assessment: Measurement Error versus Selection Shift
Abstract
Video-based gait assessment often keeps only high-confidence pose observations, which can lower measurement error but change the movement assessed. We compared confidence selection with budget-matched random selection in a Parkinson-related cohort (n = 96) and an NF2-related replication cohort (n = 18). In the Parkinson-related cohort, confidence selection produced a small but consistent shift in the observed movement summary (+0.05 SD, 95% CI 0.03 to 0.07), while held-out Mini-BESTest error stayed flat (-0.04 points, -0.13 to 0.05); a policy preserving motion-group proportions reduced the shift, while NF2 showed no shift and its predictor did not beat a constant baseline. Because this shift mixes measurement error with selection shift, we decompose and simulate both on the cohort's window structure. Filtering lowers local error when error depends on confidence, but biases the endpoint once confidence tracks movement more than error. In the Parkinson-related data, confidence was only weakly tied to movement (rho = 0.14). There, filtering is harmless if well-tracked windows are unbiased. If instead systematic error only redistributes within participants, filtering can add up to 0.58 degrees. Unchanged clinical error from such small-cohort predictors therefore cannot show that quality filtering preserves the assessed movement.
Related
- Confidence: Its Measurement, Relation to Behavior, and Neural Representation
- Benchmarking interface confidence as a selection criterion for computational nanobody design against survivin's BIR-domain groove
- Significance filtering induces denominator selection bias in local genetic correlation: closed-form characterisation, a gate-aware correction, and an applicability diagnostic
- On the size of the model selection problem in a conjoint measurement experiment
- Mechanisms and measurement of attention in laboratory tasks versus naturalistic learning contexts
BibTeX
@misc{regev2026confidence,
title = {{Confidence Filtering in Video-Based Gait Assessment: Measurement Error versus Selection Shift}},
author = {David Regev and Eran Beeri Bamani},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.39704},
eprint = {2610.39704},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.39704},
}
RIS
TY - UNPB
TI - Confidence Filtering in Video-Based Gait Assessment: Measurement Error versus Selection Shift
AU - David Regev
AU - Eran Beeri Bamani
PY - 2026
DA - 2026/10/29
PB - arXiv
DO - 10.48550/arxiv.2610.39704
UR - https://arxiv.org/abs/2610.39704
AB - Video-based gait assessment often keeps only high-confidence pose observations, which can lower measurement error but change the movement assessed. We compared confidence selection with budget-matched random selection in a Parkinson-related cohort (n = 96) and an NF2-related replication cohort (n = 18). In the Parkinson-related cohort, confidence selection produced a small but consistent shift in the observed movement summary (+0.05 SD, 95% CI 0.03 to 0.07), while held-out Mini-BESTest error stayed flat (-0.04 points, -0.13 to 0.05); a policy preserving motion-group proportions reduced the shift, while NF2 showed no shift and its predictor did not beat a constant baseline. Because this shift mixes measurement error with selection shift, we decompose and simulate both on the cohort's window structure. Filtering lowers local error when error depends on confidence, but biases the endpoint once confidence tracks movement more than error. In the Parkinson-related data, confidence was only weakly tied to movement (rho = 0.14). There, filtering is harmless if well-tracked windows are unbiased. If instead systematic error only redistributes within participants, filtering can add up to 0.58 degrees. Unchanged clinical error from such small-cohort predictors therefore cannot show that quality filtering preserves the assessed movement.
ER -