{
  "abstract": "Objectives: Assessment of simulated cardiac arrest performance is resource-intensive and subject to inter-rater variability. We evaluated whether a multimodal artificial intelligence (AI) system could score video-recorded cardiac arrest megacode simulations with agreement comparable to expert raters.\n\nMethods: Six scripted megacode simulations (three ventricular fibrillation, three pulseless electrical activity) representing exemplar, guideline-deviation and non-technical-deficiency performance were scored by two ACLS instructors using a validated team-leader checklist; consensus ratings served as the reference. Two operators analysed each video with Gemini 1.5 Pro at three temperature settings (504 item-level ratings). We calculated Cohen’s kappa, Gwet’s AC1, and sensitivity and specificity for identifying performed and omitted actions, and compared AI self-reported confidence between correct and incorrect ratings.\n\nResults: Expert inter-rater agreement was κ = 0.78 (95% CI 0.64–0.93). AI–expert agreement was κ = 0.62 (95% CI 0.49–0.75; range 0.40–0.86 across configurations) and AC1 = 0.77. The AI identified performed actions with high sensitivity (0.98, 95% CI 0.96–0.99) but detected omitted actions poorly (specificity 0.58, 95% CI 0.44–0.72), particularly omissions defined by timing or sequence. Temperature had no consistent effect. Incorrect ratings of actions as performed carried lower mean self-reported confidence than correct ones (93.6 vs 98.1), but 48% were made with maximal confidence.\n\nConclusions: A multimodal AI system reliably confirmed completed actions but frequently failed to detect omitted actions, yielding moderate overall agreement that was below expert–expert agreement. Current systems may support, but not replace, expert assessment of cardiac arrest simulation.",
  "abstract_shown": true,
  "affiliations": [
    "Acute Care Research Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada",
    "Department of Family Medicine, McGill University, Montreal, Quebec, Canada",
    "Department of Anesthesiology and Pain Medicine, University of Ottawa, Ottawa, Ontario, Canada",
    "Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada",
    "Centre for Innovation in Medical Education, University of Ottawa, Ottawa, Ontario, Canada",
    "Department of Innovation in Medical Education, University of Ottawa, Ottawa, Ontario, Canada"
  ],
  "article_type": "brief report",
  "arxiv": null,
  "author_total": 12,
  "authors": [
    {
      "affs": [
        0,
        1
      ],
      "name": "Pierre-Marc Dion"
    },
    {
      "affs": [
        2
      ],
      "name": "Jennifer Cardenas-Mancera"
    },
    {
      "affs": [
        3,
        4
      ],
      "name": "Claire Touchie"
    },
    {
      "affs": [
        5
      ],
      "name": "Vicki LeBlanc"
    },
    {
      "affs": [
        2
      ],
      "name": "Arnaud Mbadjeu"
    },
    {
      "affs": [
        0,
        2
      ],
      "name": "Curtis Nickel"
    },
    {
      "affs": [
        2
      ],
      "name": "Richard Waldolf"
    },
    {
      "affs": [
        0
      ],
      "name": "YeonJung Yoo"
    },
    {
      "affs": [
        0
      ],
      "name": "Lucas Bergamascki"
    },
    {
      "affs": [
        2
      ],
      "name": "Pooyan Sekhavati"
    },
    {
      "affs": [
        2
      ],
      "name": "Simone Crooks"
    },
    {
      "affs": [
        0,
        2
      ],
      "name": "Yuqi Gu"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/73pp23g70cvmt.bib",
  "cited_by": 0,
  "doi": "10.1016/j.resplu.2026.101517",
  "fulltext_url": "https://pmc.ncbi.nlm.nih.gov/articles/PMC13697277/",
  "id": "73pp23g70cvmt",
  "issns": [
    "2666-5204"
  ],
  "landing_url": "https://doi.org/10.1016/j.resplu.2026.101517",
  "language": "en",
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "heading",
      "Short Paper"
    ],
    [
      "openalex",
      "2711|Cardiac Arrest and Resuscitation"
    ]
  ],
  "openalex": "W7220703844",
  "pdf_url": "https://europepmc.org/articles/PMC13697277?pdf=render",
  "pmcid": "PMC13697277",
  "pmid": "42935848",
  "published": "2026-10-06",
  "publisher": "Elsevier",
  "ris": "https://research.draconitic.com/paper/73pp23g70cvmt.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:18:21Z",
      "native_id": "PMC13697277",
      "source": "pmc",
      "url": "https://doi.org/10.1016/j.resplu.2026.101517"
    },
    {
      "first_seen": "2026-10-30T12:22:24Z",
      "native_id": "MED:42935848",
      "source": "europepmc",
      "url": "https://europepmc.org/article/MED/42935848"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "openalex:2711|Cardiac Arrest and Resuscitation",
      "subfield": "general"
    }
  ],
  "title": "Multimodal artificial intelligence assessment of simulated cardiac arrest performance: a pilot study",
  "title_text": "Multimodal artificial intelligence assessment of simulated cardiac arrest performance: a pilot study",
  "type": "peer-reviewed",
  "updated_at": "2026-10-30T12:34:20Z",
  "url": "https://research.draconitic.com/paper/73pp23g70cvmt",
  "venue": "Resuscitation Plus",
  "versions": []
}