Towards a conceptual clarification and possible applications of Meehl’s crud factor: A preregistered systematic review
Abstract
Paul E. Meehl’s crud factor posits that variables in the social and behavioural sciences are never entirely unrelated, encapsulated in the notion that “everything correlates with everything”. This preregistered systematic review examined how the crud factor and Lykken’s related concept of ambient noise have been defined, interpreted, and applied across research fields. We identified 424 works through database searches and citation tracking and analysed conceptual attributes and citation intentions. Among works allowing an inference about the relationship between the two concepts, the crud factor and ambient noise were almost uniformly treated as interchangeable, and both were most frequently invoked to argue that null-hypothesis significance testing against an exact-zero effect is unsuitable for corroborating theories. Reported numerical conventions for the crud factor varied widely, indicating no established empirical benchmark. Based on the synthesis, we propose an operational definition within the multitrait-multimethod validation framework: narrow-sense crud comprises heterotrait-heteromethod associations unexplained by substantive theory or theories of methodological artifacts, whereas broad-sense crud additionally encompasses heterotrait-monomethod associations and thus method-related covariance. This distinction provides a basis for empirically estimating the magnitude of the crud factor and evaluating its methodological implications.
Related
- Software Defect Prediction: A Systematic Review and a Conceptual Framework for Stable, Actionable Explanations (AISD-F)
- A clarification of Fermi's formula for the maximum of partial sums
- Ask Before You Optimize: Dynamic Pre-Formulation Clarification for Interactive Optimization
- Below what training size do deep tabular generators stop beating trivial baselines? A preregistered benchmark on a size ladder of clinical and standard datasets
- Persistence collapse transitions and observable admissibility in nonlinear dynamical systems: a preregistered empirical benchmark
BibTeX
@misc{beckenbach2026towards,
title = {{Towards a conceptual clarification and possible applications of Meehl’s crud factor: A preregistered systematic review}},
author = {Robin Beckenbach and Ulrich Tran and Can Evenkamp and Susanne Kerschbaumer and Martin Voracek},
howpublished = {PsyArXiv},
year = {2026},
month = nov,
doi = {10.31234/osf.io/n2y8s_v1},
url = {https://osf.io/preprints/psyarxiv/n2y8s_v1/},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Towards a conceptual clarification and possible applications of Meehl’s crud factor: A preregistered systematic review
AU - Robin Beckenbach
AU - Ulrich Tran
AU - Can Evenkamp
AU - Susanne Kerschbaumer
AU - Martin Voracek
PY - 2026
DA - 2026/11/03
PB - PsyArXiv
DO - 10.31234/osf.io/n2y8s_v1
UR - https://osf.io/preprints/psyarxiv/n2y8s_v1/
AB - Paul E. Meehl’s crud factor posits that variables in the social and behavioural sciences are never entirely unrelated, encapsulated in the notion that “everything correlates with everything”. This preregistered systematic review examined how the crud factor and Lykken’s related concept of ambient noise have been defined, interpreted, and applied across research fields. We identified 424 works through database searches and citation tracking and analysed conceptual attributes and citation intentions. Among works allowing an inference about the relationship between the two concepts, the crud factor and ambient noise were almost uniformly treated as interchangeable, and both were most frequently invoked to argue that null-hypothesis significance testing against an exact-zero effect is unsuitable for corroborating theories. Reported numerical conventions for the crud factor varied widely, indicating no established empirical benchmark. Based on the synthesis, we propose an operational definition within the multitrait-multimethod validation framework: narrow-sense crud comprises heterotrait-heteromethod associations unexplained by substantive theory or theories of methodological artifacts, whereas broad-sense crud additionally encompasses heterotrait-monomethod associations and thus method-related covariance. This distinction provides a basis for empirically estimating the magnitude of the crud factor and evaluating its methodological implications.
ER -