Vision-language representations link food perception to subjective valuation
- 1Hitotsubashi University
Abstract
Subjective values of foods guide dietary decisions. Yet, how the brain computes such values from visual input remains unclear. Here, we show that visual food valuation relies on higher-level conceptual representations captured by a multimodal vision-language deep neural network model. Using food images and human ratings (N = 194 and 200), we found that a vision-language model predicted subjective value more accurately than vision-only models. Representational analyses demonstrated that, compared with the vision-only model, the vision-language model preferentially encoded higher-level food attributes, including perceived healthiness, while encoding less image-level visual information. Multivariate analyses of fMRI data (N = 31) showed that embedding features from both models corresponded to activity patterns along the visual pathways. Critically, vision-language features showed greater correspondence than vision-only features in the fusiform gyrus, a downstream region of the ventral visual pathway. These findings suggest that higher-level conceptual representations link visual food processing to subjective valuation.
Related
- Brain alignment of reasoning and action representations from vision-language and action models during naturalistic gameplay
- Luminance and attentional modulation of size perception in peripheral vision: Response to Bedell and Johnson
- Does one size fit all? Comment on Jurkiewicz et al., Attentional modulation of size perception in peripheral vision.
- Subjective and objective approaches in the study of conscious perception
- Reward Valuation in Large Language Models: Causal Induction of Anhedonia
BibTeX
@misc{aoki2026visionlanguage,
title = {{Vision-language representations link food perception to subjective valuation}},
author = {Y. Aoki and A. Toyama and M. Sugawara and H. Kojima and Y. Yamashita and S. SUZUKI},
howpublished = {bioRxiv},
year = {2026},
month = nov,
doi = {10.64898/2026.11.01.763512},
url = {https://www.biorxiv.org/content/10.64898/2026.11.01.763512v1},
note = {CC BY-NC},
}
RIS
TY - UNPB
TI - Vision-language representations link food perception to subjective valuation
AU - Y. Aoki
AU - A. Toyama
AU - M. Sugawara
AU - H. Kojima
AU - Y. Yamashita
AU - S. SUZUKI
PY - 2026
DA - 2026/11/01
PB - bioRxiv
DO - 10.64898/2026.11.01.763512
UR - https://www.biorxiv.org/content/10.64898/2026.11.01.763512v1
AB - Subjective values of foods guide dietary decisions. Yet, how the brain computes such values from visual input remains unclear. Here, we show that visual food valuation relies on higher-level conceptual representations captured by a multimodal vision-language deep neural network model. Using food images and human ratings (N = 194 and 200), we found that a vision-language model predicted subjective value more accurately than vision-only models. Representational analyses demonstrated that, compared with the vision-only model, the vision-language model preferentially encoded higher-level food attributes, including perceived healthiness, while encoding less image-level visual information. Multivariate analyses of fMRI data (N = 31) showed that embedding features from both models corresponded to activity patterns along the visual pathways. Critically, vision-language features showed greater correspondence than vision-only features in the fusiform gyrus, a downstream region of the ventral visual pathway. These findings suggest that higher-level conceptual representations link visual food processing to subjective valuation.
ER -