{
  "abstract": "Objective: Multilevel modelling of therapist effects (TE) and institutional effects (IE) is standard in psychotherapy research, yet empirical sample-size guidance is scarce for TE and virtually absent for IE. Existing recommendations rely on rules of thumb from two-level designs that vary widely across sources and do not extend to three-level structures. We aimed to provide empirically derived design recommendations for reliably detecting TE and IE in three-level psychotherapy studies. Methods: We conducted a fully factorial Monte Carlo simulation crossing six design factors: true TE, true IE, patient allocation (balanced vs. unbalanced), patients per therapist, therapists per institution, and number of institutions. This yielded 52,488 unique conditions, each with 1,000 replications. For every condition we fitted a three-level random-intercept model and derived parametric bootstrap 95% confidence intervals for both intraclass correlations, evaluating bias, RMSE, coverage, and statistical power at three pre-registered thresholds. Results: Detecting TE was feasible across a wide range of realistic designs, requiring as few as 10 to 40 total therapists for moderate effects (TE ≥ 0.05). Detecting IE, in contrast, was strongly constrained by the number of institutions: no design with fewer than four institutions reached 80% power at the primary threshold, and adequate detection of small to moderate IE (≤ 0.20) required at least five institutions with substantial within-institution sampling. Conclusion: Reliably detecting IE imposes qualitatively different design requirements than TE, particularly regarding the minimum number of institutions. We provide cutoff tables and a Shiny application to support empirically informed sample-size decisions.",
  "abstract_shown": true,
  "affiliations": [],
  "article_type": null,
  "arxiv": null,
  "author_total": 6,
  "authors": [
    {
      "name": "Juan Segundo Peña Loray"
    },
    {
      "name": "Björn S. Siepe"
    },
    {
      "name": "Miriam Hehlmann"
    },
    {
      "name": "Anne-Katharina Deisenhofer"
    },
    {
      "name": "Robin Anno Wester"
    },
    {
      "name": "Julian Rubel"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/c97jzzpw8enwq.bib",
  "cited_by": 0,
  "doi": "10.31234/osf.io/gswc9_v1",
  "fulltext_url": null,
  "id": "c97jzzpw8enwq",
  "issns": [],
  "landing_url": "https://osf.io/preprints/psyarxiv/gswc9_v1/",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "bepress",
      "Clinical Psychology"
    ],
    [
      "bepress",
      "Quantitative Methods"
    ],
    [
      "bepress",
      "Social and Behavioral Sciences"
    ],
    [
      "openalex",
      "2613|Statistical Methods and Bayesian Inference"
    ]
  ],
  "openalex": "W7214437866",
  "pdf_url": "https://osf.io/gswc9/download",
  "pmcid": null,
  "pmid": null,
  "published": "2026-09-26",
  "publisher": null,
  "ris": "https://research.draconitic.com/paper/c97jzzpw8enwq.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:23:36Z",
      "native_id": "gswc9",
      "source": "osf",
      "url": "https://osf.io/preprints/psyarxiv/gswc9_v1/"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "bepress:Clinical Psychology",
      "subfield": "psychiatry"
    }
  ],
  "title": "Beyond Rules of Thumb: Empirical Sample Size Requirements for Detecting Institutional Effects in the context of Therapist Effects",
  "title_text": "Beyond Rules of Thumb: Empirical Sample Size Requirements for Detecting Institutional Effects in the context of Therapist Effects",
  "type": "preprint",
  "updated_at": "2026-10-30T12:23:36Z",
  "url": "https://research.draconitic.com/paper/c97jzzpw8enwq",
  "venue": "PsyArXiv",
  "versions": []
}