Evaluating performance bias in face-to-BMI vision transformer models across diverse human populations
- 1University of Utah
Abstract
Computer vision models that estimate body mass index (BMI) from facial features offer a non-invasive, low-cost alternative to physical measurement, with uses in telemedicine, emergency care where a scale or measuring tools arent available, automated self-monitoring, and large-scale epidemiological research. Most of these models, however, are trained on government records, social media images, and celebrity photographs, sources that introduce dataset biases and fail to represent the general public. This study tests how well a face-to-BMI machine learning model generalizes across populations, specifically how morphological diversity and population-specific training data affect cross-cultural accuracy. We trained and evaluated Vision Transformer (ViT-H/14) models on paired BMI measurements and facial photographs from four Indigenous populations: the Orang Asli of Malaysia, the Ju/hoansi of Southern Africa, the Sama residing in the Philippines, and the Tsimane of Bolivia. To evaluate how training data composition affects predictions, we compared four training strategies, from single-population models (focal models) to models trained on the full combined global dataset (global models). In-distribution training always produced the best performance. Models exposed to a target populations morphology, whether focal or global, consistently predicted BMI most accurately for that population. But when a target population differed from the training sample, adding more cross-cultural variation to training improved out-of-distribution predictions. Therefore, training on a populations own data works best when that data exists, and training on data spanning a wide range of human morphology is the strongest fallback when it doesnt. These findings suggest that while target population training data produces the most accurate results, training on datasets that capture global morphological variation substantially improves performance in unrepresented populations. Broader diversity in training data is essential for developing machine learning health tools that generalize reliably across human populations.
Related
- A lightweight privacy-aware federated vision transformer for tomato leaf disease classification
- Hybrid local–global vision transformer framework for robust plant disease detection in precision agriculture
- A hybrid EfficientNet-B0-CBAM-Vision Transformer framework for accurate cherry leaf disease classification
- Multi-scale vision transformer model with UAV-based hyperspectral imagery for early identification of pine wilt disease infected trees
- Evaluating in-context learning with prompting regimes for transformer-based synthetic health tabular data generation
BibTeX
@misc{hoffman2026evaluating,
title = {{Evaluating performance bias in face-to-BMI vision transformer models across diverse human populations}},
author = {J. Hoffman and M. Gurven and H. Kaplan and J. Stieglitz and B. C. Trumble and B. Beheim and P. L. Hooper and R. B. Lee and J. R. Phelps and K. Hill and B. F. Codding and S. Brewer and Y. A. L. Lim and A. J. Lea and I. J. Wallace and V. V. Venkataraman and T. S. Kraft},
howpublished = {bioRxiv},
year = {2026},
month = sep,
doi = {10.64898/2026.09.02.748815},
url = {https://www.biorxiv.org/content/10.64898/2026.09.02.748815v1},
note = {CC BY},
}
RIS
TY - UNPB
TI - Evaluating performance bias in face-to-BMI vision transformer models across diverse human populations
AU - J. Hoffman
AU - M. Gurven
AU - H. Kaplan
AU - J. Stieglitz
AU - B. C. Trumble
AU - B. Beheim
AU - P. L. Hooper
AU - R. B. Lee
AU - J. R. Phelps
AU - K. Hill
AU - B. F. Codding
AU - S. Brewer
AU - Y. A. L. Lim
AU - A. J. Lea
AU - I. J. Wallace
AU - V. V. Venkataraman
AU - T. S. Kraft
PY - 2026
DA - 2026/09/02
PB - bioRxiv
DO - 10.64898/2026.09.02.748815
UR - https://www.biorxiv.org/content/10.64898/2026.09.02.748815v1
AB - Computer vision models that estimate body mass index (BMI) from facial features offer a non-invasive, low-cost alternative to physical measurement, with uses in telemedicine, emergency care where a scale or measuring tools arent available, automated self-monitoring, and large-scale epidemiological research. Most of these models, however, are trained on government records, social media images, and celebrity photographs, sources that introduce dataset biases and fail to represent the general public. This study tests how well a face-to-BMI machine learning model generalizes across populations, specifically how morphological diversity and population-specific training data affect cross-cultural accuracy. We trained and evaluated Vision Transformer (ViT-H/14) models on paired BMI measurements and facial photographs from four Indigenous populations: the Orang Asli of Malaysia, the Ju/hoansi of Southern Africa, the Sama residing in the Philippines, and the Tsimane of Bolivia. To evaluate how training data composition affects predictions, we compared four training strategies, from single-population models (focal models) to models trained on the full combined global dataset (global models). In-distribution training always produced the best performance. Models exposed to a target populations morphology, whether focal or global, consistently predicted BMI most accurately for that population. But when a target population differed from the training sample, adding more cross-cultural variation to training improved out-of-distribution predictions. Therefore, training on a populations own data works best when that data exists, and training on data spanning a wide range of human morphology is the strongest fallback when it doesnt. These findings suggest that while target population training data produces the most accurate results, training on datasets that capture global morphological variation substantially improves performance in unrepresented populations. Broader diversity in training data is essential for developing machine learning health tools that generalize reliably across human populations.
ER -