Temporal Stability of Repeated Self-Reported vs Device-Measured Behavior: Observational Study Using Ecological Momentary Assessment
Abstract
Background
A central concern in ecological momentary assessment (EMA) research is whether repeated self-report alters the reporting process itself. In most EMA domains, longitudinal stability of reporting is assumed but rarely tested.Objective
This study leveraged concurrent accelerometry as a temporal anchor to evaluate (1) whether self-reported physical activity (PA) and sedentary behavior (SB) exhibited temporal shifts across a 7-day monitoring period and (2) whether this temporal shift differed across near-momentary (5-min reporting period) and coverage-based (120-min recall period) EMA protocols.Methods
We conducted a secondary analysis of 315 US adults recruited from the Understanding America Study panel between January and July 2023 for the current study. Participants were monitored in their natural environments for 7 days via 2 measurement methods: continuous thigh-worn activPAL4 accelerometry and 5 daily smartphone EMA prompts assessing PA and SB. Reporting reactivity was defined as divergence in the temporal trajectories of EMA-reported behavior relative to accelerometry. Multilevel models with random intercepts and slopes tested whether linear and quadratic study day effects differed across the 2 methods (method × study day interactions). Protocol differences were examined using multivariable method × protocol × study day interactions, comparing coverage-based and near-momentary EMA designs.Results
In the coverage-based protocol, EMA-reported PA and SB exhibited temporal trajectories that diverged significantly from concurrent accelerometry (SB linear divergence: b=1.40, 95% CI 0.20-2.61, P=.02; PA linear divergence: b=-1.91, 95% CI -2.93 to -0.90, P<.001; and PA quadratic divergence: b=0.28, 95% CI 0.12-0.44, P<.001). No evidence of such divergence was found in the near-momentary protocol. The divergence in reporting trajectories differed significantly between the 2 protocols (SB linear 3-way interaction: b=-2.58, P=.02; PA linear 3-way interaction: b=1.86, P=.04).Conclusions
Reporting reactivity in EMA appears protocol-dependent. The coverage-based protocol was associated with modest reporting reactivity, which challenges the common assumption of reporting invariance in EMA and underscores the importance of considering protocol design when interpreting within-person change.
Related
- A study on the temporal network characteristics of early post-chemotherapy core symptoms in colorectal cancer patients based on ecological momentary assessment
- Leveraging ecological momentary assessment and dynamic structural equation modeling to identify idiographic antecedents of child irritability and defiance
- Ecological momentary assessment of anxiety and depression in individuals with early-treated phenylketonuria
- An Experimental Evaluation of Assessment Reactivity in Ecological Momentary Assessment of Alcoholics Anonymous Involvement and Alcohol-Related Outcomes: One Day at a Time
- Baseline depressive-symptom severity and divergent psychological trajectories during GIP and/or GLP-1 receptor agonist therapy: a prospective ecological momentary assessment study
BibTeX
@article{toledo2026temporal,
title = {{Temporal Stability of Repeated Self-Reported vs Device-Measured Behavior: Observational Study Using Ecological Momentary Assessment}},
author = {Meynard John L Toledo and Stefan Schneider and Joshua Smyth and Doerte Junghaenel and Arthur Stone},
journal = {Journal of Medical Internet Research},
year = {2026},
month = oct,
doi = {10.2196/99953},
url = {https://doi.org/10.2196/99953},
note = {CC BY},
}
RIS
TY - JOUR
TI - Temporal Stability of Repeated Self-Reported vs Device-Measured Behavior: Observational Study Using Ecological Momentary Assessment
AU - Meynard John L Toledo
AU - Stefan Schneider
AU - Joshua Smyth
AU - Doerte Junghaenel
AU - Arthur Stone
PY - 2026
DA - 2026/10/23
JO - Journal of Medical Internet Research
DO - 10.2196/99953
UR - https://doi.org/10.2196/99953
AB - Background A central concern in ecological momentary assessment (EMA) research is whether repeated self-report alters the reporting process itself. In most EMA domains, longitudinal stability of reporting is assumed but rarely tested.Objective This study leveraged concurrent accelerometry as a temporal anchor to evaluate (1) whether self-reported physical activity (PA) and sedentary behavior (SB) exhibited temporal shifts across a 7-day monitoring period and (2) whether this temporal shift differed across near-momentary (5-min reporting period) and coverage-based (120-min recall period) EMA protocols.Methods We conducted a secondary analysis of 315 US adults recruited from the Understanding America Study panel between January and July 2023 for the current study. Participants were monitored in their natural environments for 7 days via 2 measurement methods: continuous thigh-worn activPAL4 accelerometry and 5 daily smartphone EMA prompts assessing PA and SB. Reporting reactivity was defined as divergence in the temporal trajectories of EMA-reported behavior relative to accelerometry. Multilevel models with random intercepts and slopes tested whether linear and quadratic study day effects differed across the 2 methods (method × study day interactions). Protocol differences were examined using multivariable method × protocol × study day interactions, comparing coverage-based and near-momentary EMA designs.Results In the coverage-based protocol, EMA-reported PA and SB exhibited temporal trajectories that diverged significantly from concurrent accelerometry (SB linear divergence: b=1.40, 95% CI 0.20-2.61, P=.02; PA linear divergence: b=-1.91, 95% CI -2.93 to -0.90, P<.001; and PA quadratic divergence: b=0.28, 95% CI 0.12-0.44, P<.001). No evidence of such divergence was found in the near-momentary protocol. The divergence in reporting trajectories differed significantly between the 2 protocols (SB linear 3-way interaction: b=-2.58, P=.02; PA linear 3-way interaction: b=1.86, P=.04).Conclusions Reporting reactivity in EMA appears protocol-dependent. The coverage-based protocol was associated with modest reporting reactivity, which challenges the common assumption of reporting invariance in EMA and underscores the importance of considering protocol design when interpreting within-person change.
SN - 1438-8871
SN - 1439-4456
ER -