Reporting of Qualitative Research Using Large Language Models (COREQ+LLM): A Delphi-based Extension of the COREQ Reporting Guideline
- 1Witten/Herdecke University
Abstract
BackgroundQualitative research provides insights into human behavior, perspectives, and lived experience. While existing standards like the Consolidated Criteria for Reporting Qualitative Research (COREQ) have improved transparency and rigor, the integration of large language models (LLMs) into qualitative research introduces new challenges for not covered by current guidelines. LLMs transform analytic processes and blur the line between human interpretation and algorithmic text generation, raising concerns about transparency, authorship, and epistemic trust. The here presented COREQ+LLM guideline extends COREQ to establish comprehensive reporting standards for LLM use in qualitative research.
MethodsThe study followed the EQUATOR Networks guideline development framework in two phases: (1) a systematic scoping review to identify best practices for reporting LLM use in qualitative research, and (2) a Delphi consensus process with international experts in qualitative research, AI, medicine, ethics, and journal editing to develop a comprehensive reporting checklist.
FindingsThe scoping review identified 149 studies relevant for full-text review. From this literature, 29 preliminary reporting items were extracted. In the first Delphi round, international experts (N=141) assessed the items relevance. 20 items were accepted for inclusion in the guideline (>75% agreement); however, four required reevaluation in the second round, five underwent wording revisions, and six new items were proposed. In the second Delphi round (N=115; retention rate 82%), one was excluded, while four items still lacked consensus. Remaining items were discussed in a virtual consensus conference with nine representatives of the expert panel, resulting in the inclusion of two and the exclusion of two others. The final checklist comprises 31 items grouped into seven categories, serving as an extension of the original COREQ checklist.
InterpretationCOREQ+LLM offers structured, consensus-based guidance to enhance transparency, reproducibility, and methodological rigor in qualitative research using LLMs. Its adoption will support researchers, reviewers, and editors in maintaining trust and scientific integrity.
Related
- FIM Motorcycling sport-specific extension of the IOC consensus statement: methods for recording and reporting of epidemiological data on injury and illness in sport 2020.
- Effect Estimates, Effect Sizes, Confidence Intervals, and P-values: A Framework for Reporting and Interpreting Biomedical Research
- The Use of Causal Language in Case Reports and Case Series Reporting Ischemic Stroke Following Cervical Manual Therapy: A Qualitative Study Protocol
- An Evaluation of the Guidelines for Premature Rupture of Membranes Based on the Appraisal of Guidelines for Research and Evaluation II, the Scientific, Transparent, and Applicable Rankings, and the Reporting Items for Practice Guidelines in Health Care Methods
- Researchers' perspectives on donor-level metadata collection and reporting for human tissue research.
BibTeX
@misc{fehring2026reporting,
title = {{Reporting of Qualitative Research Using Large Language Models (COREQ+LLM): A Delphi-based Extension of the COREQ Reporting Guideline}},
author = {L. Fehring and J. Frings and P. Rust and C. Kempny and P. Thuermann and E. Tamerler and S. Meister},
howpublished = {medRxiv},
year = {2026},
month = oct,
doi = {10.64898/2026.10.01.26364479},
url = {https://www.medrxiv.org/content/10.64898/2026.10.01.26364479v1},
note = {CC BY},
}
RIS
TY - UNPB
TI - Reporting of Qualitative Research Using Large Language Models (COREQ+LLM): A Delphi-based Extension of the COREQ Reporting Guideline
AU - L. Fehring
AU - J. Frings
AU - P. Rust
AU - C. Kempny
AU - P. Thuermann
AU - E. Tamerler
AU - S. Meister
PY - 2026
DA - 2026/10/01
PB - medRxiv
DO - 10.64898/2026.10.01.26364479
UR - https://www.medrxiv.org/content/10.64898/2026.10.01.26364479v1
AB - BackgroundQualitative research provides insights into human behavior, perspectives, and lived experience. While existing standards like the Consolidated Criteria for Reporting Qualitative Research (COREQ) have improved transparency and rigor, the integration of large language models (LLMs) into qualitative research introduces new challenges for not covered by current guidelines. LLMs transform analytic processes and blur the line between human interpretation and algorithmic text generation, raising concerns about transparency, authorship, and epistemic trust. The here presented COREQ+LLM guideline extends COREQ to establish comprehensive reporting standards for LLM use in qualitative research. MethodsThe study followed the EQUATOR Networks guideline development framework in two phases: (1) a systematic scoping review to identify best practices for reporting LLM use in qualitative research, and (2) a Delphi consensus process with international experts in qualitative research, AI, medicine, ethics, and journal editing to develop a comprehensive reporting checklist. FindingsThe scoping review identified 149 studies relevant for full-text review. From this literature, 29 preliminary reporting items were extracted. In the first Delphi round, international experts (N=141) assessed the items relevance. 20 items were accepted for inclusion in the guideline (>75% agreement); however, four required reevaluation in the second round, five underwent wording revisions, and six new items were proposed. In the second Delphi round (N=115; retention rate 82%), one was excluded, while four items still lacked consensus. Remaining items were discussed in a virtual consensus conference with nine representatives of the expert panel, resulting in the inclusion of two and the exclusion of two others. The final checklist comprises 31 items grouped into seven categories, serving as an extension of the original COREQ checklist. InterpretationCOREQ+LLM offers structured, consensus-based guidance to enhance transparency, reproducibility, and methodological rigor in qualitative research using LLMs. Its adoption will support researchers, reviewers, and editors in maintaining trust and scientific integrity.
ER -