Characteristic Facial Expressions During Visual Fixation in Japanese Older Adults With Lower Cognitive Screening Performance: Exploratory Cross-Sectional Study
9 affiliations
- 1Department of Developmental and Clinical Psychology, The Division of Human Developmental Sciences, Graduate School of Humanities and Sciences, Ochanomizu University, Tokyo, Japan
- 2RIKEN Center for Advanced Intelligence Project, Nihonbashi 1-chome Mitsui Building, 15th floor, 1-4-1 Nihonbashi, Chuo-ku, Tokyo, 103-0027, Japan, 81 3-6225-2482
- 3Japan Society for the Promotion of Science, Tokyo, Japan
- 4Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, United Kingdom
- 5Institute for Mental Health, School of Psychology, University of Birmingham, Birmingham, United Kingdom
- 6School of Humanities and Science, Kumamoto Campus, Tokai University, Kumamoto, Japan
- 7Department of Neuropsychiatry, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
- 8Japan Advanced Institute of Science and Technology, Ishikawa, Japan
- 9Faculty of Core Research, Ochanomizu University, Tokyo, Japan
Abstract
Background: Early identification of older adults with lower cognitive screening performance may facilitate appropriate clinical evaluation and intervention to delay the progress of cognitive decline and onset of dementia. Because facial information can be acquired noninvasively and unobtrusively during everyday life, it has attracted increasing attention as a potential digital biomarker. However, it remains unclear which facial regions are associated with cognitive decline under a neutral facial condition. Furthermore, it is unknown whether these facial characteristics primarily reflect static facial appearance or facial movements.
Objective: This study aimed to identify facial action unit (AU) patterns associated with lower cognitive screening performance during a fixation-cross viewing condition that is less susceptible to the influence of language and emotional elicitation.
Methods: Older adults were classified into either a lower cognitive screening performance group (Montreal Cognitive Assessment Japanese version [MoCA-J] score ≤25; n=31) or a healthy control group (MoCA-J score ≥26; n=14). Facial videos were recorded while participants viewed a fixation cross for 1 minute. OpenFace 2.0 was used to extract the intensities of 17 AUs and the presence of 18 AUs. Video analyses were first performed to identify AU characteristics associated with cognitive screening performance. For AU intensity, frame-level mixed-effects models with participant-specific random intercepts and a first-order autoregressive (AR(1)) correlation structure were used, adjusting for age, Geriatric Depression Scale score, and sex, and participant-level sensitivity analyses were conducted to assess the consistency of the frame-level findings. For AU presence, participant-level analyses were performed because the frame-level models did not yield reliable parameter estimates. Subsequently, single-frame analyses were performed to examine whether the AU characteristics identified in the video analyses could be explained solely by static facial appearance. As this study was exploratory and hypothesis-generating, P values were not adjusted for multiple comparisons.
Results: For AU intensity, frame-level video analyses showed that the lower cognitive screening performance group had a higher probability of zero intensity for AU10 (upper lip raiser), with participant-level analysis based on the proportion of zero-intensity frames yielding consistent results. In contrast, single-frame analyses of AU intensity showed no significant group difference for AU10, suggesting that the observed difference may reflect facial movements rather than static facial appearance. For AU presence, video analyses showed no significant group differences.
Conclusions: Older adults with lower cognitive screening performance exhibited distinct AU patterns related to AU10 (upper lip raiser) during fixation-cross viewing, which may reflect subtle differences in facial movements around the mouth. These exploratory findings identify candidate facial biomarkers associated with lower cognitive screening performance and warrant validation in larger, balanced, independent samples.
Related
- Cognitive and affective networks in patients referred for cognitive screening: latent profiles, bridge nodes, and exploratory directional structures
- Barriers, facilitators, and prioritised service-improvement suggestions across the breast and cervical cancer screening journey: a two-phase exploratory study in rural multi-ethnic northwestern China
- Searching for the Ideal Selection of Cognitive Screening Tasks for Early Detection of Cognitive Decline in Older Individuals With Low Literacy
- A Feasible Machine Learning Approach to Improve Cognitive Screening in Multiple Sclerosis
- Predicting 1-year outcomes after anterior cruciate ligament reconstruction from preoperative physical performance using machine learning: an exploratory study
BibTeX
@article{miyayama2026characteristic,
title = {{Characteristic Facial Expressions During Visual Fixation in Japanese Older Adults With Lower Cognitive Screening Performance: Exploratory Cross-Sectional Study}},
author = {Mirano Miyayama and Takuya Sekiguchi and Hikaru Sugimoto and Toshikazu Kawagoe and Kornkanok Tripanpitak and Alexandra Wolf and Kazumi Kumagai and Kosuke Fukumori and Kumi Watanabe Miura and Shogo Okada and Keiichiro Ishimaru and Mihoko Otake-Matsuura},
journal = {JMIR Formative Research},
year = {2026},
month = oct,
doi = {10.2196/99948},
url = {https://doi.org/10.2196/99948},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - Characteristic Facial Expressions During Visual Fixation in Japanese Older Adults With Lower Cognitive Screening Performance: Exploratory Cross-Sectional Study
AU - Mirano Miyayama
AU - Takuya Sekiguchi
AU - Hikaru Sugimoto
AU - Toshikazu Kawagoe
AU - Kornkanok Tripanpitak
AU - Alexandra Wolf
AU - Kazumi Kumagai
AU - Kosuke Fukumori
AU - Kumi Watanabe Miura
AU - Shogo Okada
AU - Keiichiro Ishimaru
AU - Mihoko Otake-Matsuura
PY - 2026
DA - 2026/10/27
JO - JMIR Formative Research
DO - 10.2196/99948
UR - https://doi.org/10.2196/99948
AB - Background: Early identification of older adults with lower cognitive screening performance may facilitate appropriate clinical evaluation and intervention to delay the progress of cognitive decline and onset of dementia. Because facial information can be acquired noninvasively and unobtrusively during everyday life, it has attracted increasing attention as a potential digital biomarker. However, it remains unclear which facial regions are associated with cognitive decline under a neutral facial condition. Furthermore, it is unknown whether these facial characteristics primarily reflect static facial appearance or facial movements. Objective: This study aimed to identify facial action unit (AU) patterns associated with lower cognitive screening performance during a fixation-cross viewing condition that is less susceptible to the influence of language and emotional elicitation. Methods: Older adults were classified into either a lower cognitive screening performance group (Montreal Cognitive Assessment Japanese version [MoCA-J] score ≤25; n=31) or a healthy control group (MoCA-J score ≥26; n=14). Facial videos were recorded while participants viewed a fixation cross for 1 minute. OpenFace 2.0 was used to extract the intensities of 17 AUs and the presence of 18 AUs. Video analyses were first performed to identify AU characteristics associated with cognitive screening performance. For AU intensity, frame-level mixed-effects models with participant-specific random intercepts and a first-order autoregressive (AR(1)) correlation structure were used, adjusting for age, Geriatric Depression Scale score, and sex, and participant-level sensitivity analyses were conducted to assess the consistency of the frame-level findings. For AU presence, participant-level analyses were performed because the frame-level models did not yield reliable parameter estimates. Subsequently, single-frame analyses were performed to examine whether the AU characteristics identified in the video analyses could be explained solely by static facial appearance. As this study was exploratory and hypothesis-generating, P values were not adjusted for multiple comparisons. Results: For AU intensity, frame-level video analyses showed that the lower cognitive screening performance group had a higher probability of zero intensity for AU10 (upper lip raiser), with participant-level analysis based on the proportion of zero-intensity frames yielding consistent results. In contrast, single-frame analyses of AU intensity showed no significant group difference for AU10, suggesting that the observed difference may reflect facial movements rather than static facial appearance. For AU presence, video analyses showed no significant group differences. Conclusions: Older adults with lower cognitive screening performance exhibited distinct AU patterns related to AU10 (upper lip raiser) during fixation-cross viewing, which may reflect subtle differences in facial movements around the mouth. These exploratory findings identify candidate facial biomarkers associated with lower cognitive screening performance and warrant validation in larger, balanced, independent samples.
SN - 2561-326X
ER -