A family-aware All of Us benchmark for polygenic prediction and genomic machine learning
- 1Reticular
Abstract
Polygenic risk scores (PRSs) have improved substantially in predictive performance, yet results remain difficult to compare across studies that differ in cohorts, phenotype definitions, and evaluation procedures. Comparison to machine-learning methods is harder still, since their performance depends strongly on how data are partitioned and whether related individuals leak across splits. Here, we introduce a family-aware benchmark for polygenic prediction built on version 9 of the All of Us Research Program (AoU). The benchmark assigns entire family components to fixed discovery, calibration, and test partitions, reserves first-degree relatives for within-family evaluation, and separates models trained only on AoU discovery data from those using external GWAS summary statistics. This enables direct comparison between conventional PRS pipelines and machine-learning models trained under identical data budgets. We report results for 14 binary disease traits. Our strongest scores explain 5.7-24.9% of liability-scale variance, with particularly strong prediction for Alzheimers disease, type 2 diabetes, prostate cancer, glaucoma, and inflammatory bowel disease, and match or exceed published commercial and academic scores for most traits. Across 12 traits with interpretable within-family estimates of within-sibship-to-population effect ratio, 11 confidence intervals included a ratio of 1. Type 2 diabetes showed an attenuation ratio of 0.86 [0.76, 0.97].
Related
- Predicting MCI-to-Alzheimer’s Conversion: A Systematic Benchmark of Classical, Machine Learning, and Deep Survival Models
- Timing and Context Features in Machine Learning Classification of Inter-Patient ECG Heartbeats on the MIT-BIH Benchmark
- A Reproducible Benchmark for Leakage-Resistant Machine Learning on Multi-Site Brain Connectivity Graphs
- Genetic Architecture and Sample Size Impact Relative Performance of Nonlinear Machine Learning and Standard Polygenic Risk Scores
- Polygenic and machine learning analysis of medication response in a prospective pediatric cohort initiating ADHD medication
BibTeX
@misc{ren2026familyaware,
title = {{A family-aware All of Us benchmark for polygenic prediction and genomic machine learning}},
author = {G. Ren and K. Wu and C. Ren and I. Nyiha and K. Wu and J. Yang},
howpublished = {medRxiv},
year = {2026},
month = oct,
doi = {10.64898/2026.10.22.26366229},
url = {https://www.medrxiv.org/content/10.64898/2026.10.22.26366229v1},
note = {CC BY-NC},
}
RIS
TY - UNPB
TI - A family-aware All of Us benchmark for polygenic prediction and genomic machine learning
AU - G. Ren
AU - K. Wu
AU - C. Ren
AU - I. Nyiha
AU - K. Wu
AU - J. Yang
PY - 2026
DA - 2026/10/22
PB - medRxiv
DO - 10.64898/2026.10.22.26366229
UR - https://www.medrxiv.org/content/10.64898/2026.10.22.26366229v1
AB - Polygenic risk scores (PRSs) have improved substantially in predictive performance, yet results remain difficult to compare across studies that differ in cohorts, phenotype definitions, and evaluation procedures. Comparison to machine-learning methods is harder still, since their performance depends strongly on how data are partitioned and whether related individuals leak across splits. Here, we introduce a family-aware benchmark for polygenic prediction built on version 9 of the All of Us Research Program (AoU). The benchmark assigns entire family components to fixed discovery, calibration, and test partitions, reserves first-degree relatives for within-family evaluation, and separates models trained only on AoU discovery data from those using external GWAS summary statistics. This enables direct comparison between conventional PRS pipelines and machine-learning models trained under identical data budgets. We report results for 14 binary disease traits. Our strongest scores explain 5.7-24.9% of liability-scale variance, with particularly strong prediction for Alzheimers disease, type 2 diabetes, prostate cancer, glaucoma, and inflammatory bowel disease, and match or exceed published commercial and academic scores for most traits. Across 12 traits with interpretable within-family estimates of within-sibship-to-population effect ratio, 11 confidence intervals included a ratio of 1. Type 2 diabetes showed an attenuation ratio of 0.86 [0.76, 0.97].
ER -