{
  "abstract": "2BackgroundMendelian randomization (MR) has been widely used to investigate causal relationships between exposures and outcomes. However, concerns have also been raised about the reporting quality of MR studies. STROBE-MR was developed as a reporting guideline for MR studies, but assessments of compliance with STROBE-MR in published MR studies remain limited and rely largely on manual review. With the rapid development of large language models (LLMs), it is now possible to automate STROBE-MR compliance assessment.\n\nMethodsWe developed a pipeline using OpenAIs GPT-5-mini model for automated assessment of MR reporting quality. Model performance was evaluated on an annotated dataset of 46 eligible MR articles. We applied the pipeline to more than 13,000 MR articles published between 2005 and 2025 to assess compliance with the STROBE-MR guideline and to explore reporting patterns across STROBE-MR items, sections, and time periods. Complete compliance required reporting all applicable components of an item; a sensitivity analysis used a partial compliance criterion requiring at least one applicable component.\n\nResultsOur LLM-based pipeline agreed with the human consensus on 89.0% of the STROBE-MR assessments. On average, 22 of 43 items (51.2%) met the complete compliance criterion, with substantial variation in reporting rates across STROBE-MR items and sections. The least reported items were found in the \"Methods\", \"Results\", and \"Other Information\" sections. The number of reported items remained stable over time, with slight decreases after 2021. Sensitivity analysis showed that temporal trend patterns differed between complete and partial compliance, particularly in the Methods, Discussion and Other Information sections.\n\nConclusionsThis study demonstrates the potential of LLMs to automate reporting quality assessment in MR studies. Our results suggest that reporting quality still needs to be improved, and further efforts are required to promote the use of STROBE-MR. Our findings also suggest potential refinements to the STROBE-MR guideline to support more consistent application.\n\n1 Key PointsO_ST_ABSQuestionC_ST_ABSCan large language models (LLMs) accurately assess adherence to the STROBE-MR reporting guideline in Mendelian randomization (MR) studies, and what patterns can we observe in MR reporting?\n\nFindingsThe LLM-based approach achieved good agreement with human consensus (89.0%) and identified substantial variation in reporting quality across STROBE-MR items and sections. No improvement in number of items reported was observed since the introduction of the STROBE-MR guideline.\n\nMeaningLLMs can enable scalable assessment of reporting guideline compliance, providing a practical approach for monitoring reporting quality. Further efforts are needed to promote the use of reporting guidelines for MR studies.",
  "abstract_shown": true,
  "affiliations": [
    "University of Bristol"
  ],
  "article_type": "PUBLISHAHEADOFPRINT",
  "arxiv": null,
  "author_total": 7,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "J. Zhou"
    },
    {
      "name": "X. Wang"
    },
    {
      "name": "Z. Xu"
    },
    {
      "name": "E. Simpson"
    },
    {
      "name": "J. P. Higgins"
    },
    {
      "name": "T. R. Gaunt"
    },
    {
      "name": "Y. Liu"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/0mn20684vcmcq.bib",
  "cited_by": 0,
  "doi": "10.64898/2026.10.21.26366143",
  "fulltext_url": "https://www.medrxiv.org/content/10.64898/2026.10.21.26366143v1.full",
  "id": "0mn20684vcmcq",
  "issns": [],
  "landing_url": "https://www.medrxiv.org/content/10.64898/2026.10.21.26366143v1",
  "language": null,
  "licence": "CC-BY",
  "licence_label": "CC BY",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "medrxiv",
      "public and global health"
    ],
    [
      "openalex",
      "1804|Meta-analysis and systematic reviews"
    ]
  ],
  "openalex": "W7223474019",
  "pdf_url": "https://www.medrxiv.org/content/10.64898/2026.10.21.26366143v1.full.pdf",
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-21",
  "publisher": null,
  "ris": "https://research.draconitic.com/paper/0mn20684vcmcq.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:21:40Z",
      "native_id": "10.64898/2026.10.21.26366143",
      "source": "medrxiv",
      "url": "https://www.medrxiv.org/content/10.64898/2026.10.21.26366143v1"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "medrxiv:public and global health",
      "subfield": "epidemiology-public-health"
    }
  ],
  "title": "Reporting Quality of Mendelian Randomization Studies Based on STROBE-MR: An Investigation Powered by Large Language Models",
  "title_text": "Reporting Quality of Mendelian Randomization Studies Based on STROBE-MR: An Investigation Powered by Large Language Models",
  "type": "preprint",
  "updated_at": "2026-10-30T12:21:40Z",
  "url": "https://research.draconitic.com/paper/0mn20684vcmcq",
  "venue": "medRxiv",
  "versions": []
}