Metatheoretical multiverse analysis: Improving the reliability of research with theories-as-data
Abstract
Here we present a method for measuring, analyzing and reducing theoretical uncertainty. We call it metatheoretical multiverse analysis (MMA). The method is important because the reliability and replicability of scientific observation and testing of a phenomenon are a function of theoretical uncertainty thus reducing it is a method for improving theory. The MMA method requires encoding theory as propositional logic between variables (nodes) and their relationships with one another (edges). Propositional logic models are treated as causal path models in our method, which enable mathematical properties of testing and identification underlying their causal propositions. By encoding theories-as-data including their unknown components, it is possible to generate a multiverse of alternatively plausible theoretical models which can then be meta-analyzed using techniques borrowed from (statistical) multiverse analysis. We introduce metrics for studying theoretical multiverses that enable measuring and identifying the causes of metatheoretical uncertainty. This guides researchers to where it is best to invest theoretical development to reduce uncertainty. We use three simulations and a dedicated software package to demonstrate this method.
Related
- Psychometric Tests: Quantifying the Consequences of Low Reliability and Improving Reliability Estimation
- The Equational Theories Project: Advancing Collaborative Mathematical Research at Scale
- CausalSmith: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference
- On Some Reliability Aspects of Inverse Kies Distribution and Applications in Cancer Research
- A reliability data aggregation method for fusion-oriented research facilities
BibTeX
@misc{breznau2026metatheoretical,
title = {{Metatheoretical multiverse analysis: Improving the reliability of research with theories-as-data}},
author = {Nate Breznau and Hung H. V. Nguyen},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.09190},
eprint = {2609.09190},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.09190},
note = {CC BY-NC-ND 4.0},
}
RIS
TY - UNPB
TI - Metatheoretical multiverse analysis: Improving the reliability of research with theories-as-data
AU - Nate Breznau
AU - Hung H. V. Nguyen
PY - 2026
DA - 2026/09/01
PB - arXiv
DO - 10.48550/arxiv.2609.09190
UR - https://arxiv.org/abs/2609.09190
AB - Here we present a method for measuring, analyzing and reducing theoretical uncertainty. We call it metatheoretical multiverse analysis (MMA). The method is important because the reliability and replicability of scientific observation and testing of a phenomenon are a function of theoretical uncertainty thus reducing it is a method for improving theory. The MMA method requires encoding theory as propositional logic between variables (nodes) and their relationships with one another (edges). Propositional logic models are treated as causal path models in our method, which enable mathematical properties of testing and identification underlying their causal propositions. By encoding theories-as-data including their unknown components, it is possible to generate a multiverse of alternatively plausible theoretical models which can then be meta-analyzed using techniques borrowed from (statistical) multiverse analysis. We introduce metrics for studying theoretical multiverses that enable measuring and identifying the causes of metatheoretical uncertainty. This guides researchers to where it is best to invest theoretical development to reduce uncertainty. We use three simulations and a dedicated software package to demonstrate this method.
ER -