{
  "abstract": "Objective This study evaluated whether otolaryngologists can distinguish between human‐ and machine‐written abstracts. The primary question was whether large language models (LLMs) produce abstracts comparable in clarity and usefulness to human‐authored work, and whether reviewers can identify authorship with accuracy. Methods A blinded cross‐sectional design was used. Forty‐eight abstracts were evaluated, consisting of twenty‐four human‐authored abstracts and 24 generated by four LLMs. Human abstracts were drawn from articles published after July 2025 to minimize overlap with LLM training data. Twenty otolaryngologists independently reviewed all abstracts. Using a structured rubric, raters classified authorship, rated clarity, usefulness, and confidence on 5‐point scales, and provided optional free‐text explanations. Group comparisons were performed using chi‐square and Mann–Whitney tests, with Kruskal–Wallis tests for model‐level analyses. Results Overall recognition accuracy was 44.7%. Human‐written abstracts were more often misclassified as AI than AI‐generated abstracts were mistaken for human. Human abstracts received significantly higher clarity and usefulness scores than LLM abstracts, though effect sizes were small. Confidence did not correlate with correctness, indicating miscalibration of rater judgments. Model‐level performance varied. Grok‐generated abstracts were most easily identified as AI, whereas GPT‐5 and Claude 3.5 more frequently resembled human writing. Free‐text rationales commonly referenced style, vagueness, or lack of detail when AI authorship was suspected. Conclusion LLMs generate abstracts that increasingly resemble human scientific writing, yet still lag in perceived usefulness and credibility. Clinicians were only moderately successful at detecting authorship and were frequently confident in incorrect classifications. These findings highlight both the promise and risks of AI‐assisted scientific communication.",
  "abstract_shown": true,
  "affiliations": [
    "City St. George's University London School of Medicine, Program Delivered by University of Nicosia at the Chaim Sheba Medical Center Ramat Gan Israel",
    "Department of Otolaryngology ‐ Head and Neck Surgery Stanford University School of Medicine Stanford California USA",
    "Department of Otolaryngology ‐ Head and Neck Surgery Medical University of Vienna Vienna Austria",
    "Department of Otorhinolaryngology Academic Hospital “Santa Maria della Misericordia”, Azienda Sanitaria Universitaria Friuli Centrale Udine Italy",
    "Hospices Civils de Lyon, Hôpital Lyon Sud, Service d'ORL, d'otoneurochirurgie et de Chirurgie Cervico‐faciale Pierre Bénite France",
    "Department of Otorhinolaryngology‐Head and Neck Surgery McGovern Medical School at the University of Texas Health Science Center Houston Texas USA",
    "Department of Ophthalmology University of Missouri Kansas City Kansas City Missouri USA",
    "Faculty of Medicine Tel Aviv University Tel Aviv Israel"
  ],
  "article_type": null,
  "arxiv": null,
  "author_total": 13,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Sholem Hack"
    },
    {
      "affs": [
        0
      ],
      "name": "Rebecca Attal"
    },
    {
      "affs": [
        1
      ],
      "name": "Lirit Levi"
    },
    {
      "affs": [
        2
      ],
      "name": "David T. Liu"
    },
    {
      "affs": [
        1
      ],
      "name": "Mahdokht Manavi"
    },
    {
      "affs": [
        3
      ],
      "name": "Luca Giovanni Locatello"
    },
    {
      "affs": [
        4
      ],
      "name": "Maxime Fieux"
    },
    {
      "affs": [
        5
      ],
      "name": "Evan M. deJoya"
    },
    {
      "affs": [
        6
      ],
      "name": "Joel M. Gutovitz"
    },
    {
      "affs": [
        7
      ],
      "name": "Shahar Eliahu"
    },
    {
      "affs": [
        7
      ],
      "name": "Tal Hefetz"
    },
    {
      "affs": [
        7
      ],
      "name": "Tomer Boldes"
    },
    {
      "affs": [
        7
      ],
      "name": "Ameen Biadsee"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/5a1hkt87973yw.bib",
  "cited_by": 1,
  "doi": "10.1002/wjo2.70104",
  "fulltext_url": "https://doi.org/10.1002/wjo2.70104",
  "id": "5a1hkt87973yw",
  "issns": [
    "2589-1081",
    "2095-8811"
  ],
  "landing_url": "https://doi.org/10.1002/wjo2.70104",
  "language": "en",
  "licence": "CC-BY",
  "licence_label": "CC BY",
  "licence_source": "journal",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "lcc",
      "RD1-811"
    ],
    [
      "lcc",
      "RF1-547"
    ],
    [
      "openalex",
      "1207|Academic Writing and Publishing"
    ]
  ],
  "openalex": "W7140197622",
  "pdf_url": null,
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-23",
  "publisher": "Wiley",
  "ris": "https://research.draconitic.com/paper/5a1hkt87973yw.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T13:44:00Z",
      "native_id": "d9abf64d051e473eb851949154c5d8cc",
      "source": "doaj",
      "url": "https://doi.org/10.1002/wjo2.70104"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "lcc:RD1-811",
      "subfield": "surgery"
    }
  ],
  "title": "Clarity Without Credibility? Human Versus AI Abstracts in Otolaryngology",
  "title_text": "Clarity Without Credibility? Human Versus AI Abstracts in Otolaryngology",
  "type": "peer-reviewed",
  "updated_at": "2026-10-30T13:44:00Z",
  "url": "https://research.draconitic.com/paper/5a1hkt87973yw",
  "venue": "World Journal of Otorhinolaryngology-Head and Neck Surgery",
  "versions": []
}