Development and content validity of an AI-assisted simulation scenario for orthotic fabrication in occupational therapy education
6 affiliations
- 1Department of Occupational Therapy, Faculty of Health Sciences, Lokman Hekim University, Söğütözü Mh. 2185 Cd. No: 20/J, Çankaya, Ankara, 06510 Türkiye
- 2Department of Occupational Therapy, Faculty of Health Sciences, Hacettepe University, Ankara, Türkiye
- 3Department of Physiotherapy and Rehabilitation, Faculty of Health Sciences, Lokman Hekim University, Ankara, Türkiye
- 4Department of Obstetric and Gynecology Nursing, Faculty of Health Sciences, Lokman Hekim University, Ankara, Türkiye
- 5Department of Surgical Nursing, Faculty of Health Sciences, Lokman Hekim University, Ankara, Türkiye
- 6Department of Health Services Management, Faculty of Health Sciences, Lokman Hekim University, Ankara, Türkiye
Abstract
Background: Developing high-fidelity simulation scenarios is a time-consuming process, and validated resources for complex psychomotor skills such as orthotic fabrication are scarce. This study aimed to examine the content validity index (CVI) of a simulation scenario for anticlaw orthosis fabrication developed with the support of artificial intelligence (AI).
Methods: A mixed-methods methodological study was conducted in an academic education program in Türkiye. Six subject matter experts with professional experience in hand rehabilitation, orthotics, and simulation-based education participated. A simulation scenario package was structured by the researchers, while the specific scenario flow was generated using a seven-step process supported by the generative AI tool ChatGPT. Expert reviewers evaluated five components, specifically objectives, background, prebriefing, scenario flow, and debriefing, using a 4-point Likert scale and open-ended questions. The item-level content validity index (I-CVI) and scale level content validity index (S-CVI) were calculated.
Results: The simulation scenario package was evaluated across five core components. The scenario achieved an I-CVI and S-CVI of 1.00. This indicated that all expert reviewers rated the scenario components as content valid by assigning a score of 3 or 4. Qualitative feedback highlighted the need for refinements in clinical fidelity, specific material choices, and safety warnings regarding heat and sharp tools.
Conclusions: The study provided educators with a comprehensive, ready-to-implement simulation scenario package, including validated learning objectives, prebriefing instructions, the full scenario script developed via AI-assisted methodology, and debriefing guides, that could be adopted to enhance orthotic training in rehabilitation curricula.
Supplementary Information: The online version contains supplementary material available at https://doi.org/10.1186/s12909-026-10043-x.
Related
- Development and validity and reliability testing of a questionnaire on life and death education cognition and selection preference of cancer patients
- BMI category, recorded diagnosis composition, and occupational medicine certificate validity: the POLOCARIA study, 2016–2025
- Assessment in competency-based medical education for anesthesiology: validity evidence, equity, and faculty readiness
- Localized Debriefing Assessment for Simulation in Healthcare (DASH): Medical Student Engagement and Debriefing Assessment Validity
- Evaluating the effectiveness of a MOOC-based flipped classroom approach in occupational health and occupational medicine education.
BibTeX
@article{alatas2026development,
title = {{Development and content validity of an AI-assisted simulation scenario for orthotic fabrication in occupational therapy education}},
author = {Duygu Mine Alataş and Çiğdem Öksüz and Nilgün Bek and Özlem Ülkü Bulut and Kamile Akarsu and Mevlüt Karadağ and Aynur Ayşe Karaduman},
journal = {BMC Medical Education},
year = {2026},
month = jul,
doi = {10.1186/s12909-026-10043-x},
url = {https://doi.org/10.1186/s12909-026-10043-x},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - Development and content validity of an AI-assisted simulation scenario for orthotic fabrication in occupational therapy education
AU - Duygu Mine Alataş
AU - Çiğdem Öksüz
AU - Nilgün Bek
AU - Özlem Ülkü Bulut
AU - Kamile Akarsu
AU - Mevlüt Karadağ
AU - Aynur Ayşe Karaduman
PY - 2026
DA - 2026/07/29
JO - BMC Medical Education
DO - 10.1186/s12909-026-10043-x
UR - https://doi.org/10.1186/s12909-026-10043-x
AB - Background: Developing high-fidelity simulation scenarios is a time-consuming process, and validated resources for complex psychomotor skills such as orthotic fabrication are scarce. This study aimed to examine the content validity index (CVI) of a simulation scenario for anticlaw orthosis fabrication developed with the support of artificial intelligence (AI). Methods: A mixed-methods methodological study was conducted in an academic education program in Türkiye. Six subject matter experts with professional experience in hand rehabilitation, orthotics, and simulation-based education participated. A simulation scenario package was structured by the researchers, while the specific scenario flow was generated using a seven-step process supported by the generative AI tool ChatGPT. Expert reviewers evaluated five components, specifically objectives, background, prebriefing, scenario flow, and debriefing, using a 4-point Likert scale and open-ended questions. The item-level content validity index (I-CVI) and scale level content validity index (S-CVI) were calculated. Results: The simulation scenario package was evaluated across five core components. The scenario achieved an I-CVI and S-CVI of 1.00. This indicated that all expert reviewers rated the scenario components as content valid by assigning a score of 3 or 4. Qualitative feedback highlighted the need for refinements in clinical fidelity, specific material choices, and safety warnings regarding heat and sharp tools. Conclusions: The study provided educators with a comprehensive, ready-to-implement simulation scenario package, including validated learning objectives, prebriefing instructions, the full scenario script developed via AI-assisted methodology, and debriefing guides, that could be adopted to enhance orthotic training in rehabilitation curricula. Supplementary Information: The online version contains supplementary material available at https://doi.org/10.1186/s12909-026-10043-x.
SN - 1472-6920
ER -