{
  "abstract": "Objectives: To map applications of large language models (LLMs) in rheumatology and evaluate the methodological quality and clinical translation of the evidence.\n\nMethods: MEDLINE, Embase and Web of Science were searched from inception to 13 July 2026 for primary studies of LLMs in rheumatology. Two reviewers independently screened records and analysed data. Each study was assigned to one application domain and to the highest level of a review-derived translational maturity framework. Risk of bias was assessed with the Alberta Quality Assessment Tool: Risk of Bias (AQAT:RoB; worst-item rule), where human evaluation of free-text answers was reported; findings were synthesised narratively.\n\nResults: 93 studies were included, 79 (84.9%) from 2025 or 2026. Patient education (39, 41.9%) and clinical decision support (38, 40.9%) dominated. Accuracy in clinical decision support was strongly task-dependent, with medians of 90.9% for structured diagnostic tasks and 40.0% for open-ended differential diagnosis (best-performing model per study). Patient-facing output had a median Flesch-Kincaid grade of 12.2; none of the 13 readability studies met the recommended sixth-grade target. 22 studies (23.7%) used real-world clinical data, mostly retrospectively; only four (4.3%) evaluated an LLM prospectively in a clinical workflow. Prompts were fully reported in 59.1% of studies, and answer stability was tested in 19.4%. Among the 68 studies amenable to AQAT:RoB assessment, five (7.4%) were at low risk of bias.\n\nConclusions: LLM research in rheumatology is expanding rapidly but remains dominated by prompt-response benchmarks with surrogate outcomes, incomplete reporting and, among AQAT:RoB-assessable studies, predominantly unclear or high risk of bias. Whether LLMs improve rheumatology care remains unresolved; prospective evaluations with patient-relevant endpoints are required.",
  "abstract_shown": true,
  "affiliations": [
    "Division of Rheumatology and Systemic Inflammatory Diseases, III. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany",
    "Department of Rheumatology and Clinical Immunology, Charité – University Medical Center Berlin, Berlin, Germany"
  ],
  "article_type": "research article",
  "arxiv": null,
  "author_total": 4,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Phillip Kremer",
      "orcid": "0009-0009-9897-2302"
    },
    {
      "affs": [
        0
      ],
      "name": "Isabell Haase",
      "orcid": "0000-0002-3412-6838"
    },
    {
      "affs": [
        1
      ],
      "name": "Zhivana Boyadzhieva"
    },
    {
      "affs": [
        0
      ],
      "name": "Martin Krusche",
      "orcid": "0000-0002-0582-7790"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/fwkr4gt4v8jr1.bib",
  "cited_by": 0,
  "doi": "10.1136/rmdopen-2026-007538",
  "fulltext_url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC13723917/",
  "id": "fwkr4gt4v8jr1",
  "issns": [
    "2056-5933"
  ],
  "landing_url": "https://doi.org/10.1136/rmdopen-2026-007538",
  "language": "en",
  "licence": "CC-BY-NC-4.0",
  "licence_label": "CC BY-NC 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by-nc/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "heading",
      "1506"
    ],
    [
      "heading",
      "Education"
    ],
    [
      "heading",
      "Original Research"
    ],
    [
      "openalex",
      "2718|Artificial Intelligence in Healthcare and Education"
    ]
  ],
  "openalex": "W7224098905",
  "pdf_url": null,
  "pmcid": "PMC13723917",
  "pmid": "42951304",
  "published": "2026-10-28",
  "publisher": "BMJ Publishing Group",
  "ris": "https://research.draconitic.com/paper/fwkr4gt4v8jr1.ris",
  "sources": [
    {
      "first_seen": "2026-11-04T12:22:28Z",
      "native_id": "PMC13723917",
      "source": "pmc",
      "url": "https://doi.org/10.1136/rmdopen-2026-007538"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "openalex:2718|Artificial Intelligence in Healthcare and Education",
      "subfield": "epidemiology-public-health"
    }
  ],
  "title": "Large language models in rheumatology: applications, methodological quality and clinical translation – a systematic review",
  "title_text": "Large language models in rheumatology: applications, methodological quality and clinical translation – a systematic review",
  "type": "peer-reviewed",
  "updated_at": "2026-11-05T12:20:39Z",
  "url": "https://research.draconitic.com/paper/fwkr4gt4v8jr1",
  "venue": "RMD Open",
  "versions": []
}