A primer on expert elicitation with IDEA (Investigate Discuss Estimate Aggregate) for rare disease trialists
5 affiliations
- 1Child Health Evaluative Sciences, The Hospital for Sick Children
- 2Department of Psychiatry, University of Toronto
- 3Montreal Children’s Hospital, McGill University Health Centre
- 4Regenerative Medicine Program, The Ottawa Hospital Research Institute
- 5Department of Pediatrics, Cumming School of Medicine, University of Calgary
Abstract
In clinical trials for rare diseases, small patient populations constrain recruitment, limiting data collection. Expert elicitation, the process of extracting expert beliefs into quantitative expressions, can act as a source of evidence in a setting with limited data. Expert judgement can be combined with trial data through the prior distribution in a Bayesian trial. This approach makes the most use out of the available information and possible trial recruitment, unlike conventional approaches that rely on trial data alone. Previous elicitations for rare disease trial prior distributions have used ad hoc approaches, rather than an established protocol designed to limit biases in judgement. This practical guide introduces rare disease clinical investigators to expert elicitation using the IDEA (Investigate, Discuss, Estimate, Aggregate) protocol. IDEA is a structured elicitation technique where experts individually estimate quantities, discuss their answers, then revise their estimates before aggregation into a final distribution. In an elicitation for a trial, experts can either estimate the control arm response or the treatment effect. The elicitation estimates then inform the design and analysis of the trial. IDEA has previously been described in a general context, but this paper provides tailored recommendations for conducting an elicitation for a clinical trial for a rare disease. By outlining practical steps to using IDEA, we aim to promote more structured, transparent practices that will increase the uptake and acceptance of expert elicitation to improve clinical trials for rare diseases.
Related
- Elicitation and Decision Geometry in Single-Index Bandits
- An Unbounded Gap Between Identification and Identifiable Elicitation: Central Moments
- bayprior: Structured Bayesian Prior Elicitation, Conflict Diagnostics, and Regulatory Reporting
- Behavioral Prior Elicitation via LLM for Heterogeneous-Agent Bitcoin Flash-Crash Simulation
- Local Expected Utility in Infinite-Dimensional Spaces: Theory and Elicitation
BibTeX
@article{jiang2026primer,
title = {{A primer on expert elicitation with IDEA (Investigate Discuss Estimate Aggregate) for rare disease trialists}},
author = {Arlene Jiang and Danielle A. Baribeau and John J. Mitchell and Bernard Thébaud and Nicola A. M. Wright and Anna Heath},
journal = {Journal of Rare Diseases},
year = {2026},
month = nov,
doi = {10.1007/s44162-026-00253-8},
url = {https://doi.org/10.1007/s44162-026-00253-8},
note = {CC BY},
}
RIS
TY - JOUR
TI - A primer on expert elicitation with IDEA (Investigate Discuss Estimate Aggregate) for rare disease trialists
AU - Arlene Jiang
AU - Danielle A. Baribeau
AU - John J. Mitchell
AU - Bernard Thébaud
AU - Nicola A. M. Wright
AU - Anna Heath
PY - 2026
DA - 2026/11/08
JO - Journal of Rare Diseases
DO - 10.1007/s44162-026-00253-8
UR - https://doi.org/10.1007/s44162-026-00253-8
AB - In clinical trials for rare diseases, small patient populations constrain recruitment, limiting data collection. Expert elicitation, the process of extracting expert beliefs into quantitative expressions, can act as a source of evidence in a setting with limited data. Expert judgement can be combined with trial data through the prior distribution in a Bayesian trial. This approach makes the most use out of the available information and possible trial recruitment, unlike conventional approaches that rely on trial data alone. Previous elicitations for rare disease trial prior distributions have used ad hoc approaches, rather than an established protocol designed to limit biases in judgement. This practical guide introduces rare disease clinical investigators to expert elicitation using the IDEA (Investigate, Discuss, Estimate, Aggregate) protocol. IDEA is a structured elicitation technique where experts individually estimate quantities, discuss their answers, then revise their estimates before aggregation into a final distribution. In an elicitation for a trial, experts can either estimate the control arm response or the treatment effect. The elicitation estimates then inform the design and analysis of the trial. IDEA has previously been described in a general context, but this paper provides tailored recommendations for conducting an elicitation for a clinical trial for a rare disease. By outlining practical steps to using IDEA, we aim to promote more structured, transparent practices that will increase the uptake and acceptance of expert elicitation to improve clinical trials for rare diseases.
SN - 2731-085X
ER -