{
  "abstract": "Background: Large language models may support postpartum health consultation and nursing care plan development, but their performance across different task types remains uncertain. This study compared the performance of ChatGPT 5.5 and DeepSeek V3 in these settings.\n\nMethods: A three-stage cross-sectional evaluation was conducted, comprising repeated querying of 30 guideline-based questions, consultations involving 120 postpartum women, and 120 de-identified retrospective clinical cases. Responses were evaluated by clinical experts using a blinded assessment process. In Stage 2, the postpartum women who submitted the questions also performed blinded evaluations from the user perspective. Paired-samples t tests or Wilcoxon signed-rank tests were used, as appropriate. Holm-Bonferroni correction was applied within outcome families defined by study stage and evaluator type, and intraclass correlation coefficients were calculated to assess agreement among clinical expert ratings.\n\nResults: In Stage 1, ChatGPT 5.5 received a higher correctness score than DeepSeek V3 (4.00 ± 0.00 versus 3.88 ± 0.33; Holm-adjusted p = 0.002). DeepSeek V3 received higher scores for completeness and clinical management appropriateness (both Holm-adjusted p < 0.001) and safety (Holm-adjusted p = 0.001), although its responses were more difficult to read. In Stage 2, ChatGPT 5.5 received higher patient ratings for satisfaction and usefulness and higher clinician ratings for correctness, completeness, helpfulness, and safety, whereas DeepSeek V3 received a higher clinician-rated readability score (all Holm-adjusted p < 0.001). In Stage 3, ChatGPT 5.5 received higher scores for clinical appropriateness, comprehensiveness, actionability, safety, and triage appropriateness (all Holm-adjusted p < 0.001), whereas DeepSeek V3 received a higher individualization score (Holm-adjusted p = 0.021).\n\nConclusion: LLM performance varied depending on the task, evaluation metric, and use case. ChatGPT 5.5 received higher scores across most clinically relevant dimensions in real-world postpartum consultations and nursing care plan generation, whereas DeepSeek V3 received higher scores for completeness and safety in standardized questions, clinician-rated readability in real-world consultations, and individualization in care-plan generation. LLMs may support health education and preparation of initial nursing care plan drafts, but their outputs require clinical review.",
  "abstract_shown": true,
  "affiliations": [
    "Delivery Center, Xi’an People’s Hospital (Xi’an Fourth Hospital)",
    "Women’s Health Care Center, Xi’an People’s Hospital (Xi’an Fourth Hospital)"
  ],
  "article_type": "research article",
  "arxiv": null,
  "author_total": 3,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Xilin Zhao"
    },
    {
      "affs": [
        1
      ],
      "name": "Xinwen Zhang"
    },
    {
      "affs": [
        0
      ],
      "name": "Lei Liu"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/9sypsx44k5887.bib",
  "cited_by": 0,
  "doi": "10.3389/fpubh.2026.1961647",
  "fulltext_url": "https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13727638/?tool=EBI",
  "id": "9sypsx44k5887",
  "issns": [
    "2296-2565"
  ],
  "landing_url": "https://www.frontiersin.org/articles/10.3389/fpubh.2026.1961647/full",
  "language": "eng",
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "heading",
      "Original Research"
    ],
    [
      "openalex",
      "2718|Artificial Intelligence in Healthcare and Education"
    ]
  ],
  "openalex": "W7223061133",
  "pdf_url": "https://www.frontiersin.org/journals/public-health/articles/10.3389/fpubh.2026.1961647/pdf",
  "pmcid": "PMC13727638",
  "pmid": "42978698",
  "published": "2026-10-20",
  "publisher": "Frontiers Media SA",
  "ris": "https://research.draconitic.com/paper/9sypsx44k5887.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:20:24Z",
      "native_id": "10.3389/fpubh.2026.1961647",
      "source": "crossref",
      "url": "https://www.frontiersin.org/articles/10.3389/fpubh.2026.1961647/full"
    },
    {
      "first_seen": "2026-11-04T15:20:46Z",
      "native_id": "PMC:PMC13727638",
      "source": "europepmc",
      "url": "https://europepmc.org/article/PMC/PMC13727638"
    },
    {
      "first_seen": "2026-11-06T12:23:29Z",
      "native_id": "PMC13727638",
      "source": "pmc",
      "url": "https://doi.org/10.3389/fpubh.2026.1961647"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "openalex:2718|Artificial Intelligence in Healthcare and Education",
      "subfield": "epidemiology-public-health"
    }
  ],
  "title": "Beyond accuracy: a three-stage evaluation of large language models for postpartum health consultation and nursing decision support",
  "title_text": "Beyond accuracy: a three-stage evaluation of large language models for postpartum health consultation and nursing decision support",
  "type": "peer-reviewed",
  "updated_at": "2026-11-07T12:20:47Z",
  "url": "https://research.draconitic.com/paper/9sypsx44k5887",
  "venue": "Frontiers in Public Health",
  "versions": []
}