{
  "abstract": "Biobank-scale genotyping has created unprecedented cohorts for human genetics, yet the field still lacks scalable methods for learning transferable representations from largely unlabeled individual-level genotype data. Here, we introduce SNPBERT, a self-supervised transformer pretrained on genotypes from 485 923 UK Biobank participants using masked rsID prediction. SNPBERT embeddings recovered known population structure across UK Biobank and three external datasets, performed comparably to principal component analysis, and supported the identification of ancestry-informative marker SNPs. Fine-tuning with an attention-based multiple-instance head generated disease-specific risk scores that provided complementary information beyond conventional polygenic risk scores. The relative increase in Nagelkerke’s R2 ranged from 0.7% to 3.3%, and independent associations were observed for seven of the eight chronic diseases examined. In celiac disease, attention prioritization recapitulated major histocompatibility complex signals while elevating variants in CCHCR1 and NOTCH4 relative to genome-wide association study (GWAS) ranking. These results support biobank-scale genotype pretraining as an early step toward foundation modeling for individual-level genotype data.",
  "abstract_shown": true,
  "affiliations": [
    "Department of Public Laboratory, Key Laboratory of Cancer Prevention and Therapy of Tianjin, Tianjin’s Clinical Research Center for Cancer, National Clinical Research Center for Cancer, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University , Tianjin 300060 ,",
    "Department of Epidemiology and Biostatistics, Key Laboratory of Molecular Cancer Epidemiology of Tianjin, Key Laboratory of Prevention and Control of Human Major Diseases (Ministry of Education), Tianjin’s Clinical Research Center for Cancer, National Clinical Research Center for Cancer, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University , Tianjin 300060 ,"
  ],
  "article_type": "research article",
  "arxiv": null,
  "author_total": 7,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Chao Sheng",
      "orcid": "0009-0008-9698-6391"
    },
    {
      "affs": [
        1
      ],
      "name": "Han Du"
    },
    {
      "affs": [
        1
      ],
      "name": "Hongru Shen"
    },
    {
      "affs": [
        1
      ],
      "name": "Hongji Dai",
      "orcid": "0000-0002-3009-5536"
    },
    {
      "affs": [
        1
      ],
      "name": "Fangfang Song"
    },
    {
      "affs": [
        0
      ],
      "name": "Xiangchun Li",
      "orcid": "0000-0002-2230-2152"
    },
    {
      "affs": [
        1
      ],
      "name": "Kexin Chen"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/22zc1dq6g0yxx.bib",
  "cited_by": 0,
  "doi": "10.1093/nar/gkag1059",
  "fulltext_url": "https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13717189/?tool=EBI",
  "id": "22zc1dq6g0yxx",
  "issns": [
    "0305-1048",
    "1362-4962"
  ],
  "landing_url": "https://academic.oup.com/nar/article/doi/10.1093/nar/gkag1059/9004260",
  "language": "eng",
  "licence": "CC-BY-NC-4.0",
  "licence_label": "CC BY-NC 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by-nc/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "heading",
      "AcademicSubjects/SCI00010"
    ],
    [
      "heading",
      "Genomics"
    ],
    [
      "heading",
      "Narese/34"
    ],
    [
      "heading",
      "Narese/41"
    ],
    [
      "heading",
      "Narese/8"
    ]
  ],
  "openalex": null,
  "pdf_url": "https://academic.oup.com/nar/article-pdf/54/20/gkag1059/72579585/gkag1059.pdf",
  "pmcid": "PMC13717189",
  "pmid": "42953967",
  "published": "2026-10-01",
  "publisher": "Oxford University Press (OUP)",
  "ris": "https://research.draconitic.com/paper/22zc1dq6g0yxx.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:18:50Z",
      "native_id": "10.1093/nar/gkag1059",
      "source": "crossref",
      "url": "https://academic.oup.com/nar/article/doi/10.1093/nar/gkag1059/9004260"
    },
    {
      "first_seen": "2026-10-31T00:20:37Z",
      "native_id": "PMC:PMC13717189",
      "source": "europepmc",
      "url": "https://europepmc.org/article/PMC/PMC13717189"
    },
    {
      "first_seen": "2026-11-01T00:20:44Z",
      "native_id": "MED:42953967",
      "source": "europepmc",
      "url": "https://europepmc.org/article/MED/42953967"
    },
    {
      "first_seen": "2026-11-02T12:21:33Z",
      "native_id": "PMC13717189",
      "source": "pmc",
      "url": "https://doi.org/10.1093/nar/gkag1059"
    }
  ],
  "subjects": [
    {
      "field": "biology",
      "origin": "heading:Genomics",
      "subfield": "genetics-genomics"
    }
  ],
  "title": "Biobank-scale self-supervised genotype pretraining yields transferable representations for human genetics",
  "title_text": "Biobank-scale self-supervised genotype pretraining yields transferable representations for human genetics",
  "type": "peer-reviewed",
  "updated_at": "2026-11-02T12:21:33Z",
  "url": "https://research.draconitic.com/paper/22zc1dq6g0yxx",
  "venue": "Nucleic Acids Research",
  "versions": []
}