{
  "abstract": "The scale and pace of evidence generation in digital psychiatry increasingly exceed the capacity of traditional systematic literature review (SLR) methods. Large language models (LLMs) are gaining traction in evidence synthesis, yet limited guidance exists for integrating generative AI into transparent, reproducible SLR workflows. To develop and evaluate a prompt-driven, modular decision-making framework for adaptable SLR workflows in digital psychiatry, and to compare stage-matched performance relative to a consensus-based human reference process. We conducted a mixed-methods, stage-matched comparative evaluation of three GPT-5 mode variants (Auto, Agent, and Deep Research) against a consensus-based human-led SLR workflow using a registered digital psychiatry review (PROSPERO CRD42025648122) as a case example. Nine SLR tasks were implemented within the ChatGPT interface using structured RISEN prompts: preliminary searches; research question, eligibility criteria, and search strategy development; article screening; data extraction; article summarization; critical appraisals; and descriptive results synthesis. Performance was evaluated using task-specific assessments of accuracy, sensitivity, specificity, inter-rater agreement, reporting compliance, hallucination monitoring, and workflow feasibility. All GPT-5 mode variants were feasible across SLR stages, although performance varied by task and mode. No fabricated study-level content was identified during structured hallucination auditing. Auto mode performed best for structured rule-based tasks requiring efficiency and implementation-ready outputs (e.g., eligibility criteria). Agent mode excelled in conceptual integration and interpretive tasks (e.g., research question generation, critical appraisals, descriptive synthesis). Deep Research mode most closely approximated human reasoning for higher-order synthesis tasks, performing best in full-text article screening, article summarization, and narrative synthesis. Prompt-driven LLM workflows are feasible and semi-efficacious for selected SLR tasks in digital psychiatry when deployed within a modular, human-in-the-loop decision-support framework. Findings support task-specific deployment of an adaptable modular framework, enabling healthcare researchers and clinicians to modify LLM workflows according to methodological appropriateness, confidence in performance, and institutional review practices. Author summary: Systematic literature reviews (SLRs) are essential for summarizing scientific evidence, but they are often time-intensive and require substantial human effort. Recent advances in artificial intelligence (AI), including large language models (LLMs) such as ChatGPT, have raised interest in whether these tools could support or accelerate parts of the review process. However, little is known about how well different AI configurations perform across the many stages of a systematic review. In this proof-of-concept study, we evaluated an adaptable, step-by-step workflow showing how healthcare researchers and clinicians could practically use different versions of GPT-5 to assist with nine major stages of an SLR in psychiatry. Rather than testing a fully automated system, we examined how AI might support specific parts of the process while keeping human researchers involved in reviewing and verifying outputs. We found that performance varied depending on both the task and GPT-5 mode used. Some modes performed well for structured tasks such as screening and summarizing findings, whereas all modes demonstrated limitations in extracting numerical data and critically evaluating evidence quality. Overall, our findings suggest that AI may meaningfully support evidence synthesis for end-users with limited AI background when carefully supervised, but currently works best as a flexible decision-support tool rather than a replacement for expert judgement.",
  "abstract_shown": true,
  "affiliations": [
    "AI for Mental Health Program (formerly Interventional Psychiatry Program), Department of Psychiatry, St. Michael’s Hospital, Unity Health Toronto, Toronto, Ontario, Canada",
    "Department of Psychiatry, Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada",
    "Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada",
    "Institute of Mental Health Research, The Royal Ottawa Mental Health Centre, Ottawa, Ontario, Canada",
    "Department of Psychiatry, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada",
    "Department of Psychiatry, Leiden University Medical Center, Leiden, The Netherlands",
    "Department of Psychology, NYU Grossman School of Medicine, New York, United States of America",
    "Department of Psychology, Toronto Metropolitan University, Toronto, Ontario, Canada",
    "Department of Electrical, Computer, and Biomedical Engineering, Toronto Metropolitan University, Toronto, Ontario, Canada",
    "Department of Brain Sciences, Faculty of Medicine, Imperial College London, London, United Kingdom",
    "Division of Biostatistics, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada"
  ],
  "article_type": "Research Article",
  "arxiv": null,
  "author_total": 20,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Karisa Parkington"
    },
    {
      "affs": [
        1
      ],
      "name": "Jithin T. Joseph"
    },
    {
      "affs": [
        2
      ],
      "name": "Katie Musleh"
    },
    {
      "affs": [
        3
      ],
      "name": "Marianne Rouleau-Tang"
    },
    {
      "affs": [
        4
      ],
      "name": "Annabelle Persaud"
    },
    {
      "affs": [
        5
      ],
      "name": "Alice Rueda"
    },
    {
      "affs": [
        6
      ],
      "name": "Bazen Gashaw Teferra"
    },
    {
      "affs": [
        7
      ],
      "name": "Huda F. Al-Shamali"
    },
    {
      "affs": [
        8
      ],
      "name": "Wanying Mao"
    },
    {
      "affs": [
        9
      ],
      "name": "Fatemeh Gholamali Nezhad"
    },
    {
      "affs": [
        10
      ],
      "name": "Lisa Burback"
    },
    {
      "name": "Yanbo Zhang"
    },
    {
      "name": "Rakesh Jetly"
    },
    {
      "name": "Eric Vermetten"
    },
    {
      "name": "Candice Monson"
    },
    {
      "name": "Sri Krishnan"
    },
    {
      "name": "Richard J. Zeifman"
    },
    {
      "name": "Andrew Greenshaw"
    },
    {
      "name": "Wendy Lou"
    },
    {
      "name": "Venkat Bhat"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/c79wtt0tvymy5.bib",
  "cited_by": 0,
  "doi": "10.1371/journal.pdig.0001666",
  "fulltext_url": "https://journals.plos.org/digitalhealth/article?id=10.1371/journal.pdig.0001666",
  "id": "c79wtt0tvymy5",
  "issns": [
    "2767-3170"
  ],
  "landing_url": "https://journals.plos.org/digitalhealth/article?id=10.1371/journal.pdig.0001666",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "journal",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "openalex",
      "1804|Meta-analysis and systematic reviews"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Cognitive science/Cognitive psychology/Perception/Sensory perception/Hallucinations"
    ],
    [
      "plos",
      "/Biology and life sciences/Neuroscience/Sensory perception/Hallucinations"
    ],
    [
      "plos",
      "/Biology and life sciences/Psychology/Behavior/Human performance"
    ],
    [
      "plos",
      "/Biology and life sciences/Psychology/Cognitive psychology/Perception/Sensory perception/Hallucinations"
    ],
    [
      "plos",
      "/Computer and information sciences/Artificial intelligence"
    ],
    [
      "plos",
      "/Medicine and health sciences/Mental health and psychiatry"
    ],
    [
      "plos",
      "/Medicine and health sciences/Pharmaceutics/Pharmaceutical processing technology/Drug synthesis"
    ],
    [
      "plos",
      "/Research and analysis methods/Database and informatics methods/Database searching"
    ],
    [
      "plos",
      "/Research and analysis methods/Research assessment/Reproducibility"
    ],
    [
      "plos",
      "/Research and analysis methods/Research assessment/Systematic reviews"
    ],
    [
      "plos",
      "/Social sciences/Psychology/Behavior/Human performance"
    ],
    [
      "plos",
      "/Social sciences/Psychology/Cognitive psychology/Perception/Sensory perception/Hallucinations"
    ]
  ],
  "openalex": "W7200175533",
  "pdf_url": "https://journals.plos.org/digitalhealth/article/file?id=10.1371/journal.pdig.0001666&type=printable",
  "pmcid": null,
  "pmid": null,
  "published": "2026-09-10",
  "publisher": "Public Library of Science",
  "ris": "https://research.draconitic.com/paper/c79wtt0tvymy5.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:17:56Z",
      "native_id": "10.1371/journal.pdig.0001666",
      "source": "plos",
      "url": "https://journals.plos.org/digitalhealth/article?id=10.1371/journal.pdig.0001666"
    }
  ],
  "subjects": [
    {
      "field": "biology",
      "origin": "plos:neuroscience",
      "subfield": "neuroscience"
    },
    {
      "field": "medicine",
      "origin": "plos:systematic reviews",
      "subfield": "clinical-trials"
    },
    {
      "field": "medicine",
      "origin": "plos:mental health and psychiatry",
      "subfield": "psychiatry"
    }
  ],
  "title": "Leveraging prompt-driven generative AI for systematic reviews in digital psychiatry: A stage-matched comparative proof-of-concept for healthcare researchers and clinicians",
  "title_text": "Leveraging prompt-driven generative AI for systematic reviews in digital psychiatry: A stage-matched comparative proof-of-concept for healthcare researchers and clinicians",
  "type": "peer-reviewed",
  "updated_at": "2026-10-30T12:17:56Z",
  "url": "https://research.draconitic.com/paper/c79wtt0tvymy5",
  "venue": "PLOS Digital Health",
  "versions": []
}