{
  "abstract": "Background: Parkinson’s disease (PD) requires both disease-specific knowledge and contextual clinical reasoning. However, most evaluations of medical large language models (LLMs) emphasize closed-ended questions and factual accuracy, providing limited insight into broader dimensions of performance on professional PD tasks.\n\nMethods: Nine contemporary LLMs were evaluated using a 200-item English-language professional PD benchmark spanning five clinical domains, four difficulty levels, and multiple question formats. Responses were assessed for expert-rated factual accuracy, clinical reasoning, Global Quality Scale (GQS), and Flesch–Kincaid Grade Level (FKGL).\n\nResults: The nine models generated 1,800 responses. Between-model separation was minimal for expert-rated factual accuracy (Kendall’ s W = 0.031) but greater for FKGL (W = 0.235), Clinical Reasoning (W = 0.256), and GQS (W = 0.301). Between-model separation in expert-rated factual accuracy was small for closed-ended questions (W = 0.020, p = 0.001) but greater for open-ended questions (W = 0.121, p < 0.001). Expert-rated factual accuracy remained weakly discriminative across PD domains and difficulty levels, while GQS showed the greatest domain-specific separation in Safety & Ethics (W = 0.431). Flagship variants consistently showed higher Clinical Reasoning and GQS, but not uniformly higher factual accuracy.\n\nConclusion: Contemporary LLMs showed limited between-model separation in expert-rated factual accuracy within this benchmark and scoring framework, whereas greater differentiation emerged in open-ended tasks, clinical reasoning, overall response quality, and readability. Multidimensional evaluation may therefore provide a more informative characterization of model performance and help inform task-specific model selection and oversight in medical applications.",
  "abstract_shown": true,
  "affiliations": [
    "Department of Geriatric Medicine, Tongji Hospital, School of Medicine, Tongji University",
    "Department of Neurology, Tongji Hospital, School of Medicine, Tongji University",
    "Center for Translational Neurodegeneration and Regenerative Therapy, Tongji Hospital Affiliated to Tongji University School of Medicine"
  ],
  "article_type": null,
  "arxiv": null,
  "author_total": 6,
  "authors": [
    {
      "affs": [
        0,
        1
      ],
      "name": "Ludi Xie"
    },
    {
      "affs": [
        1,
        2
      ],
      "name": "Rumeng Wei"
    },
    {
      "affs": [
        1,
        2
      ],
      "name": "Li Xiong"
    },
    {
      "affs": [
        0
      ],
      "name": "Rui Lu"
    },
    {
      "affs": [
        1
      ],
      "name": "Kangwen Peng"
    },
    {
      "affs": [
        0
      ],
      "name": "Wenlin Ma"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/6et9fn72x98w7.bib",
  "cited_by": 0,
  "doi": "10.3389/fneur.2026.1970459",
  "fulltext_url": null,
  "id": "6et9fn72x98w7",
  "issns": [
    "1664-2295"
  ],
  "landing_url": "https://www.frontiersin.org/articles/10.3389/fneur.2026.1970459/full",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [],
  "openalex": null,
  "pdf_url": null,
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-30",
  "publisher": "Frontiers Media SA",
  "ris": "https://research.draconitic.com/paper/6et9fn72x98w7.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:20:16Z",
      "native_id": "10.3389/fneur.2026.1970459",
      "source": "crossref",
      "url": "https://www.frontiersin.org/articles/10.3389/fneur.2026.1970459/full"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "issn:1664-2295",
      "subfield": "neurology"
    }
  ],
  "title": "Comparative performance of nine large language models on professional Parkinson’s disease tasks: a multidimensional benchmark study",
  "title_text": "Comparative performance of nine large language models on professional Parkinson’s disease tasks: a multidimensional benchmark study",
  "type": "peer-reviewed",
  "updated_at": "2026-11-01T00:21:05Z",
  "url": "https://research.draconitic.com/paper/6et9fn72x98w7",
  "venue": "Frontiers in Neurology",
  "versions": []
}