PaleoRigor: a bounded research agent with a reproducible evidence trail for paleomicrobiome data processing
- 1Huazhong University of Science and Technology
Abstract
Background: Ancient microbial evidence informs research on past health, diet, and environments, but its scarcity and susceptibility to contamination demand care in selecting and processing data. Language models can now turn a research request into an analysis plan, but an unconstrained planner may reference files that do not exist, apply operations a format forbids, or answer a question the data cannot settle. A planner used on such evidence therefore needs to be bounded, and its decisions recoverable afterwards. Results: We developed PaleoRigor around three commitments. Agent: a language model plans the analysis. Constraint: a validator checks every file reference, format and step dependency before anything runs, execution is restricted to predefined local modules, and a planning contract directs the model to refuse out-of-scope requests with a named reason code rather than answer them. Reproducibility: each run is exported with its plan, intermediate files, checksums and decisions. In a preregistered, frozen held-out evaluation, PaleoRigor passed 23 of 24 runs (95.8%; Wilson 95% confidence interval, 79.8-99.3%): 11 of 12 supported runs and all 12 prespecified boundary decisions. An ablation that removed this planning contract from the same model passed 19 of 24 (79.2%). Repeating the frozen design with a second model configuration yielded 24 of 24 successes for PaleoRigor and 19 of 24 for the ablated arm. Pooled post hoc across both configurations, PaleoRigor passed 47 of 48 runs (97.9%), compared with 38 of 48 (79.2%) for the ablated arms. All 96 run labels were recomputed from retained records and matched. Dataset-level tests matched read counts and compressed-file sizes for six public sequencing records and documented the removal of 114 duplicate sequence entries. A retraction-associated audit illustrated how expert review limited conclusions to file-level evidence. Conclusions: For paleomicrobiome data, pairing a language-model agent with explicit constraints and a reproducible record makes the agent's proposed analysis reviewable before its outputs support a biological claim. PaleoRigor delivers checked inputs, a recorded transformation history and a named reason for each request it refuses, and runs as a local desktop application. It prepares data for specialist analysis; ancient-DNA authentication and biological interpretation remain with the paleobiologist.
Related
- Spyglass is a framework for reproducible and shareable neuroscience research
- Idiosyncratic Eye‐Movement Patterns to Faces Are Associated With Differences in Neural Processing: Evidence From Behavioral and Event‐Related Potential Responses
- Highlighting the strengths of new wearable fNIRS, precision accuracy microgenetic research designs, and new NeuroDOT processing algorithm to measure change over time in clinical populations for Speech-Language and Hearing Researchers
- Neuropharmacology of language: ERP evidence for catecholaminergic modulation of syntactic processing
- Anterior part of fronto-temporal language network as the neural basis of morphologically structured word form processing: evidence from Korean morphologically complex word.
BibTeX
@misc{liu2026paleorigor,
title = {{PaleoRigor: a bounded research agent with a reproducible evidence trail for paleomicrobiome data processing}},
author = {T. Liu and H. Zhang and Y. Jia and K. Ning},
howpublished = {bioRxiv},
year = {2026},
month = sep,
doi = {10.64898/2026.09.30.755547},
url = {https://www.biorxiv.org/content/10.64898/2026.09.30.755547v1},
note = {CC BY},
}
RIS
TY - UNPB
TI - PaleoRigor: a bounded research agent with a reproducible evidence trail for paleomicrobiome data processing
AU - T. Liu
AU - H. Zhang
AU - Y. Jia
AU - K. Ning
PY - 2026
DA - 2026/09/30
PB - bioRxiv
DO - 10.64898/2026.09.30.755547
UR - https://www.biorxiv.org/content/10.64898/2026.09.30.755547v1
AB - Background: Ancient microbial evidence informs research on past health, diet, and environments, but its scarcity and susceptibility to contamination demand care in selecting and processing data. Language models can now turn a research request into an analysis plan, but an unconstrained planner may reference files that do not exist, apply operations a format forbids, or answer a question the data cannot settle. A planner used on such evidence therefore needs to be bounded, and its decisions recoverable afterwards. Results: We developed PaleoRigor around three commitments. Agent: a language model plans the analysis. Constraint: a validator checks every file reference, format and step dependency before anything runs, execution is restricted to predefined local modules, and a planning contract directs the model to refuse out-of-scope requests with a named reason code rather than answer them. Reproducibility: each run is exported with its plan, intermediate files, checksums and decisions. In a preregistered, frozen held-out evaluation, PaleoRigor passed 23 of 24 runs (95.8%; Wilson 95% confidence interval, 79.8-99.3%): 11 of 12 supported runs and all 12 prespecified boundary decisions. An ablation that removed this planning contract from the same model passed 19 of 24 (79.2%). Repeating the frozen design with a second model configuration yielded 24 of 24 successes for PaleoRigor and 19 of 24 for the ablated arm. Pooled post hoc across both configurations, PaleoRigor passed 47 of 48 runs (97.9%), compared with 38 of 48 (79.2%) for the ablated arms. All 96 run labels were recomputed from retained records and matched. Dataset-level tests matched read counts and compressed-file sizes for six public sequencing records and documented the removal of 114 duplicate sequence entries. A retraction-associated audit illustrated how expert review limited conclusions to file-level evidence. Conclusions: For paleomicrobiome data, pairing a language-model agent with explicit constraints and a reproducible record makes the agent's proposed analysis reviewable before its outputs support a biological claim. PaleoRigor delivers checked inputs, a recorded transformation history and a named reason for each request it refuses, and runs as a local desktop application. It prepares data for specialist analysis; ancient-DNA authentication and biological interpretation remain with the paleobiologist.
ER -