{
  "abstract": "BackgroundVisual field defects associated with brain diseases may arise from stroke, intracranial space-occupying lesions, and other central visual pathway disorders. Patient questions often span symptom recognition, explanation of causes, care triage, treatment, and rehabilitation. Large language models may improve access to patient education. However, their accuracy, logic, coherence, safety, and content accessibility have not been compared under controlled conditions in this high-risk, interdisciplinary Chinese-language setting. This study aimed to compare the performance of five selected large language models across multiple dimensions.MethodsIn this cross-sectional study, 30 fixed Chinese-language questions, refined by experts and phrased from a patient perspective, were submitted to ChatGPT 5.6 Sol, DeepSeek V4 Flash, Gemini 3.7 Flash, Qwen 3.8 Max, and Kimi K3 through a unified application programming interface (API) client. Each model generated one response per question in an independent single-turn session, with web retrieval disabled and conversation history cleared. Three raters, blinded to model identity, independently scored 150 randomly presented responses from 1 to 5 for accuracy, logic, coherence, safety, and content accessibility. Response time, word count, non-space character count, sentence count, paragraph count, and table count were also recorded. Models were compared using the Friedman test followed by Bonferroni-adjusted Wilcoxon signed-rank tests. Inter-rater agreement was assessed using Kendall’s W. Correlations were assessed using Spearman analysis with Benjamini-Hochberg false discovery rate correction.ResultsAgreement among the three raters was high across all five dimensions (Kendall’s W = 0.820–0.844; all P < 0.001). The five models differed in accuracy, coherence, and content accessibility (P < 0.001, P < 0.001, and P = 0.001, respectively). No statistically significant between-model differences were observed in logic or safety (P = 0.247 and P = 0.061, respectively). ChatGPT 5.6 Sol had the highest median accuracy score [4.67 (interquartile range, 4.00–5.00)], and Kimi K3 had the highest median coherence score [4.50 (4.00–5.00)]. Both models had a median content accessibility score of 4.67 (4.00–5.00). Response time, response length, and text structure also differed among models. However, their correlations with expert quality scores were generally weak (|ρ| ≤ 0.279).ConclusionThe five large language models exhibited distinctly multidimensional performance when answering Chinese-language patient questions about visual field defects associated with brain diseases. No single model consistently performed best across all clinically relevant dimensions. These findings are specific to the model versions tested on 15 August 2026; stability across repeated generations was not assessed. Response speed, length, and structure cannot substitute for direct assessment of medical quality. The absence of a statistically significant difference in safety ratings under controlled conditions does not imply equivalent or adequate clinical safety. Large language models are better suited to supporting patient education and clinician-patient communication under clinical supervision than to making diagnostic or treatment decisions independently.",
  "abstract_shown": true,
  "affiliations": [
    "The Second School of Clinical Medicine, Southern Medical University, Guangzhou, China",
    "School of Medical Technology and Engineering, Fujian Medical University, Fuzhou, China",
    "Department of Ophthalmology, Quzhou People’s Hospital, The Quzhou Affiliated Hospital, Wenzhou Medical University, Quzhou, China",
    "Shenzhen Eye Hospital, Shenzhen Eye Medical Center, Southern Medical University, Shenzhen, China"
  ],
  "article_type": null,
  "arxiv": null,
  "author_total": 6,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Shenghe Li"
    },
    {
      "affs": [
        1
      ],
      "name": "Ling Wang"
    },
    {
      "affs": [
        1
      ],
      "name": "Xiaoyan Wang"
    },
    {
      "affs": [
        2
      ],
      "name": "Ligang Jiang"
    },
    {
      "affs": [
        3
      ],
      "name": "Weihua Yang"
    },
    {
      "affs": [
        3
      ],
      "name": "Lu Xie"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/72458xcb7qyny.bib",
  "cited_by": 0,
  "doi": "10.3389/fphys.2026.1993774",
  "fulltext_url": "https://www.frontiersin.org/articles/10.3389/fphys.2026.1993774/full",
  "id": "72458xcb7qyny",
  "issns": [
    "1664-042X"
  ],
  "landing_url": "https://doi.org/10.3389/fphys.2026.1993774",
  "language": "en",
  "licence": "CC-BY",
  "licence_label": "CC BY",
  "licence_source": "journal",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "lcc",
      "QP1-981"
    ],
    [
      "openalex",
      "2718|Artificial Intelligence in Healthcare and Education"
    ]
  ],
  "openalex": "W7223396318",
  "pdf_url": "https://www.frontiersin.org/journals/physiology/articles/10.3389/fphys.2026.1993774/pdf",
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-23",
  "publisher": "Frontiers Media S.A.",
  "ris": "https://research.draconitic.com/paper/72458xcb7qyny.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T13:43:12Z",
      "native_id": "c80e0c0a332f432cba178aaa28f3aabb",
      "source": "doaj",
      "url": "https://doi.org/10.3389/fphys.2026.1993774"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "openalex:2718|Artificial Intelligence in Healthcare and Education",
      "subfield": "epidemiology-public-health"
    }
  ],
  "title": "A cross-sectional comparison of five large language models in answering Chinese-language patient queries on visual field defects associated with brain diseases",
  "title_text": "A cross-sectional comparison of five large language models in answering Chinese-language patient queries on visual field defects associated with brain diseases",
  "type": "peer-reviewed",
  "updated_at": "2026-10-30T13:43:12Z",
  "url": "https://research.draconitic.com/paper/72458xcb7qyny",
  "venue": "Frontiers in Physiology",
  "versions": []
}