{
  "abstract": "Aim: To compare the quality, readability, and emergency referral performance of four major language models in answering post-septorhinoplasty patient questions in Turkish and English.\n\nMaterials and Methods: A cross-sectional evaluation study comprised 31 questions: 20 routine postoperative and 11 emergency/red-flag scenarios. Each question was submitted once to ChatGPT, Google Gemini, DeepSeek, and Claude in Turkish and English within independent conversation windows. Two otolaryngologists independently evaluated the responses using the Quality Analysis of Medical Artificial Intelligence tool. English responses were additionally assessed using Flesch Reading Ease, Flesch-Kincaid Grade Level, and Simple Measure of Gobbledygook indices. Emergency referral accuracy was evaluated separately.\n\nResults: Total quality scores differed significantly among models for Turkish routine postoperative questions (p<0.001, Kendall’s W=0.775) and for Turkish emergency/red-flag questions (p=0.009, W=0.350), whereas the corresponding overall differences for English questions were not statistically significant. Within-model language comparisons showed significant Turkish-English differences for routine questions across all four models, whereas no language-related differences were observed for emergency/red-flag questions. ChatGPT, DeepSeek, and Claude provided appropriate emergency referrals in all 22 responses, whereas Gemini did so in 16 of 22 responses (72.7%). All models exceeded recommended readability thresholds for patient education materials.\n\nConclusion: The performance of large language models in post-septorhinoplasty patient education varied by language context and question category. Although emergency referral performance was generally high, model-specific omissions occurred, and all models exceeded recommended readability thresholds. These findings support language-specific evaluation, simplification to improve readability, and expert review before clinical use.",
  "abstract_shown": true,
  "affiliations": [
    "Department of Otorhinolaryngology- Head and Neck Surgery, Etlik City Hospital, Ankara, Türkiye"
  ],
  "article_type": null,
  "arxiv": null,
  "author_total": 4,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Zülküf Küçüktağ",
      "orcid": "0000-0001-6846-3771"
    },
    {
      "affs": [
        0
      ],
      "name": "Aykut Özdoğan",
      "orcid": "0009-0001-6460-3383"
    },
    {
      "affs": [
        0
      ],
      "name": "Gökçe Saygı Uysal",
      "orcid": "0000-0001-9704-3522"
    },
    {
      "affs": [
        0
      ],
      "name": "Yağmur Uluhan",
      "orcid": "0009-0009-5922-8740"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/0drawsnsz154b.bib",
  "cited_by": 0,
  "doi": "10.54307/nwmj.2026.262",
  "fulltext_url": "https://nwmedj.org/article/view/262",
  "id": "0drawsnsz154b",
  "issns": [
    "2979-9538"
  ],
  "landing_url": "https://doi.org/10.54307/nwmj.2026.262",
  "language": "en",
  "licence": "CC-BY",
  "licence_label": "CC BY",
  "licence_source": "journal",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "lcc",
      "R"
    ],
    [
      "openalex",
      "2718|Artificial Intelligence in Healthcare and Education"
    ]
  ],
  "openalex": "W7223651315",
  "pdf_url": "https://nwmedj.org/article/download/262/pdf",
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-26",
  "publisher": "Izzet Baysal Training and Research Hospital",
  "ris": "https://research.draconitic.com/paper/0drawsnsz154b.ris",
  "sources": [
    {
      "first_seen": "2026-10-31T14:21:14Z",
      "native_id": "1f7f43e5a54449f392cff60805d6bfc8",
      "source": "doaj",
      "url": "https://doi.org/10.54307/nwmj.2026.262"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "openalex:2718|Artificial Intelligence in Healthcare and Education",
      "subfield": "epidemiology-public-health"
    }
  ],
  "title": "Comparative evaluation of four large language models for postoperative patient education after septorhinoplasty: A bilingual cross-sectional study",
  "title_text": "Comparative evaluation of four large language models for postoperative patient education after septorhinoplasty: A bilingual cross-sectional study",
  "type": "peer-reviewed",
  "updated_at": "2026-10-31T14:21:14Z",
  "url": "https://research.draconitic.com/paper/0drawsnsz154b",
  "venue": "Northwestern Medical Journal",
  "versions": []
}