{
  "abstract": "Diagnostic pathology depends on complex, structured reasoning to interpret clinical, histologic, and molecular data. Replicating, or even approximating this cognitive process algorithmically remains a significant challenge. As large language models (LLMs) gain traction in medicine, it is critical to assess their clinical utility in specialized domains such as pathology. We evaluated the quality of expressed diagnostic reasoning in the outputs of four LLMs, OpenAI o1, OpenAI o3-mini, Gemini 2.0 Flash Thinking Experimental, and DeepSeek-R1, using 15 constructed-response pathology questions covering board-examination-level content across a range of cognitive demands, from factual recall to integrative knowledge synthesis. Eleven expert pathologists independently scored model-generated responses using a structured rubric encompassing five language quality metrics (accuracy, relevance, coherence, depth, and conciseness) and seven diagnostic reasoning strategies as communicated in the textual output. Scores were normalized and compared using ANOVA and Tukey’s HSD. Gemini significantly outperformed all models in overall reasoning quality, particularly in analytical depth and coherence. While all models achieved comparable factual accuracy, only Gemini and DeepSeek consistently demonstrated expert-like reasoning patterns in their outputs, including algorithmic, inductive, and Bayesian approaches. Performance varied by reasoning type, with the highest scores in algorithmic and deductive reasoning and the lowest in heuristic and pattern recognition. Gemini achieved the highest inter-observer agreement (p < 0.001), suggesting greater interpretability. However, more in-depth reasoning was generally associated with reduced conciseness. Addressing these trade-offs will be key to safe clinical integration.",
  "abstract_shown": true,
  "affiliations": [
    "Department of Cancer Epidemiology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, 33612 FL USA",
    "Department of Machine Learning, H. Lee Moffitt Cancer Center & Research Institute, Tampa, 33612 FL USA",
    "Department of Surgery, Health New Zealand, Counties Manukau, Auckland, New Zealand",
    "Armed Forces Institute of Pathology, Rawalpindi, Pakistan",
    "Department of Pathology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, 33612 FL USA",
    "Clinical Science Lab, H. Lee Moffitt Cancer Center & Research Institute, Tampa, 33612 FL USA",
    "Department of Dermatology & Cutaneous Surgery, University of South Florida, Tampa, 33612 FL USA",
    "Department of Anatomic Pathology, H. Lee Moffitt Cancer Center & Research Institute, Tampa, 33612 FL USA",
    "Dermatopathology and Digital Pathology, Summit Health, Berkley Heights, 07922 NJ USA",
    "Department of Pathology, Kameda Medical Center, Kamogawa City, Chiba Prefecture Japan",
    "Department of Pathology, The Ohio State University, Columbus, 43210 Ohio USA"
  ],
  "article_type": "research article",
  "arxiv": null,
  "author_total": 17,
  "authors": [
    {
      "affs": [
        0,
        1
      ],
      "name": "Asim Waqas",
      "orcid": "0000-0002-6834-4710"
    },
    {
      "affs": [
        2
      ],
      "name": "Ehsan Ullah",
      "orcid": "0000-0001-6470-3731"
    },
    {
      "affs": [
        3
      ],
      "name": "Asma Khan"
    },
    {
      "affs": [
        4
      ],
      "name": "Farah Khalil"
    },
    {
      "affs": [
        5
      ],
      "name": "Zarifa G. Ozturk"
    },
    {
      "affs": [
        4
      ],
      "name": "Vaibhav Chumbalkar"
    },
    {
      "affs": [
        4
      ],
      "name": "Daryoush Saeed-Vafa"
    },
    {
      "affs": [
        4
      ],
      "name": "Zena Jameel"
    },
    {
      "affs": [
        6
      ],
      "name": "Wei-Shen Chen"
    },
    {
      "affs": [
        4
      ],
      "name": "Humberto Trejo Bittar"
    },
    {
      "affs": [
        7
      ],
      "name": "Jasreman Dhillon"
    },
    {
      "affs": [
        8
      ],
      "name": "Rajendra S. Singh"
    },
    {
      "affs": [
        9
      ],
      "name": "Andrey Bychkov"
    },
    {
      "affs": [
        10
      ],
      "name": "Anil V. Parwani",
      "orcid": "0009-0007-7224-6682"
    },
    {
      "affs": [
        4
      ],
      "name": "Marilyn M. Bui",
      "orcid": "0000-0003-4963-2255"
    },
    {
      "affs": [
        0
      ],
      "name": "Matthew B. Schabath",
      "orcid": "0000-0003-3241-3216"
    },
    {
      "affs": [
        1
      ],
      "name": "Ghulam Rasool",
      "orcid": "0000-0001-8551-0090"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/dtkq1hga192vf.bib",
  "cited_by": 8,
  "doi": "10.1186/s13000-026-01809-4",
  "fulltext_url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC13741565/",
  "id": "dtkq1hga192vf",
  "issns": [
    "1746-1596"
  ],
  "landing_url": "https://doi.org/10.1186/s13000-026-01809-4",
  "language": "en",
  "licence": "CC-BY-NC-ND-4.0",
  "licence_label": "CC BY-NC-ND 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by-nc-nd/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "heading",
      "Research"
    ],
    [
      "openalex",
      "2718|Artificial Intelligence in Healthcare and Education"
    ]
  ],
  "openalex": "W7171671604",
  "pdf_url": null,
  "pmcid": "PMC13741565",
  "pmid": "42989260",
  "published": "2026-07-29",
  "publisher": "BMC",
  "ris": "https://research.draconitic.com/paper/dtkq1hga192vf.ris",
  "sources": [
    {
      "first_seen": "2026-11-10T12:22:36Z",
      "native_id": "PMC13741565",
      "source": "pmc",
      "url": "https://doi.org/10.1186/s13000-026-01809-4"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "openalex:2718|Artificial Intelligence in Healthcare and Education",
      "subfield": "epidemiology-public-health"
    }
  ],
  "title": "Reasoning beyond accuracy: expert evaluation of expressed diagnostic reasoning in large language model outputs for pathology",
  "title_text": "Reasoning beyond accuracy: expert evaluation of expressed diagnostic reasoning in large language model outputs for pathology",
  "type": "peer-reviewed",
  "updated_at": "2026-11-10T12:22:36Z",
  "url": "https://research.draconitic.com/paper/dtkq1hga192vf",
  "venue": "Diagnostic Pathology",
  "versions": []
}