Mice adapt their learning rate to stochasticity and volatility through a simple heuristic
- 1IGF, Univ. Montpellier, CNRS, Inserm, Montpellier, France
Abstract
Learning from outcomes requires weighing each surprise by how much it is likely to mean. Two properties of the environment set that weight in opposite directions: volatility, the rate at which contingencies change, and stochasticity, the noise in outcomes around a stable contingency. Whether animals separate the two is unresolved, in part because varying reward probability in a reversal task makes outcomes noisier and the two options harder to tell apart at once. We trained male and female mice on a probabilistic reversal task for intracranial self-stimulation, scaling reward magnitude with reward probability so that the expected reward of each option and the difference between them stayed constant while outcome variance varied, and crossing this with different reversal rates. Simulations show that adapting the learning rate alone and adapting the decision policy alone are near-equivalent solutions across the environments we tested. Mice adopted the first adjustment: their fitted learning rate rose with volatility and fell with stochasticity, in both directions predicted by reward maximization, while their inverse temperature stayed fixed. This joint dependence was reproduced only by a meta-learning rule that reads stochasticity from the size of prediction errors and volatility from how often recent outcomes favored switching
Related
- Stock-level volatility forecasting using machine learning: A comparative study of GARCH, Random Forest, LSTM, and GRU on US Equities
- Simple calls to increase effort influence attention, mind wandering, and learning during online lectures
- If the brain were so simple: Information-based drivers of intelligence and their interaction through an n-body-inspired framework
- Stochasticity in Metabolism: Oxidative Stress Response Phenotypes As Emergent Consequences of Network Topology
- Identifying Hemodialysis Patients With the Highest Risk of Staphylococcus aureus Endogenous Infection Through a Simple Nasal Sampling Algorithm
BibTeX
@misc{chevallier2026mice,
title = {{Mice adapt their learning rate to stochasticity and volatility through a simple heuristic}},
author = {C. Chevallier and J. Cobos Alvarez and E. Debos and E. Marillat and J. Perroy and J. Naude},
howpublished = {bioRxiv},
year = {2026},
month = sep,
doi = {10.64898/2026.09.24.754025},
url = {https://www.biorxiv.org/content/10.64898/2026.09.24.754025v1},
note = {CC BY},
}
RIS
TY - UNPB
TI - Mice adapt their learning rate to stochasticity and volatility through a simple heuristic
AU - C. Chevallier
AU - J. Cobos Alvarez
AU - E. Debos
AU - E. Marillat
AU - J. Perroy
AU - J. Naude
PY - 2026
DA - 2026/09/24
PB - bioRxiv
DO - 10.64898/2026.09.24.754025
UR - https://www.biorxiv.org/content/10.64898/2026.09.24.754025v1
AB - Learning from outcomes requires weighing each surprise by how much it is likely to mean. Two properties of the environment set that weight in opposite directions: volatility, the rate at which contingencies change, and stochasticity, the noise in outcomes around a stable contingency. Whether animals separate the two is unresolved, in part because varying reward probability in a reversal task makes outcomes noisier and the two options harder to tell apart at once. We trained male and female mice on a probabilistic reversal task for intracranial self-stimulation, scaling reward magnitude with reward probability so that the expected reward of each option and the difference between them stayed constant while outcome variance varied, and crossing this with different reversal rates. Simulations show that adapting the learning rate alone and adapting the decision policy alone are near-equivalent solutions across the environments we tested. Mice adopted the first adjustment: their fitted learning rate rose with volatility and fell with stochasticity, in both directions predicted by reward maximization, while their inverse temperature stayed fixed. This joint dependence was reproduced only by a meta-learning rule that reads stochasticity from the size of prediction errors and volatility from how often recent outcomes favored switching
ER -