Homeostasis Revisited and Reformulated Through Hidden Markov Model Control
Abstract
A common formalization of homeostasis is the free energy principle, a framework that defines a set of desired observation values, or critical states, that the agent should reach or remain close to. Under the free energy principle, an agent should act to maximize the probability of receiving the desired observations. Here we revisit the common approach of solving the problem of maximizing the log probability of the desired observations by maximizing a variational lower bound, the so-called negative free energy. We show that, instead, an approach directly maximizing that probability under the agent's policy is better suited to, and provides a better solution for, the original homeostatic control problem. This is done using hidden Markov model (HMM) control by allowing the policy to act over hidden states or noisy versions thereof while trying to maximize the probability of repeatedly having the desired observations. HMM control largely improves performance over the variational, or free energy, approach. We also show that the optimal policy is strictly deterministic, while the variational approach leads to a stochastic policy approximation. We finally provide a homeostatic reinterpretation of the maximum occupancy principle -a principle proposing that agents ought to maximize the occupancy of action-state path space -by defining homeostatic states as any states that do not immediately entail the termination or death of the agent.
Related
- Cargo levels control endosomal PI(3)P homeostasis through direct feedback between SNX17 and MTM1
- Chronic inhalation of m-xylene disrupts vascular homeostasis through endothelial injury and impaired vascular repair
- SRF3 couples cellular iron homeostasis and defense responses through ubiquitin-dependent nano-organization
- A PPARγ-like signalling axis integrates lipid homeostasis and mitochondrial quality control to preserve neuronal integrity
- Diacylglycerol Kinases Balance DAG Signaling to Control B Cell Maturation, Germinal Center Homeostasis, and Humoral Immunity
BibTeX
@misc{morenobote2026homeostasis,
title = {{Homeostasis Revisited and Reformulated Through Hidden Markov Model Control}},
author = {Rubén Moreno-Bote},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.07508},
eprint = {2609.07508},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.07508},
note = {CC BY-NC-ND 4.0},
}
RIS
TY - UNPB
TI - Homeostasis Revisited and Reformulated Through Hidden Markov Model Control
AU - Rubén Moreno-Bote
PY - 2026
DA - 2026/09/07
PB - arXiv
DO - 10.48550/arxiv.2609.07508
UR - https://arxiv.org/abs/2609.07508
AB - A common formalization of homeostasis is the free energy principle, a framework that defines a set of desired observation values, or critical states, that the agent should reach or remain close to. Under the free energy principle, an agent should act to maximize the probability of receiving the desired observations. Here we revisit the common approach of solving the problem of maximizing the log probability of the desired observations by maximizing a variational lower bound, the so-called negative free energy. We show that, instead, an approach directly maximizing that probability under the agent's policy is better suited to, and provides a better solution for, the original homeostatic control problem. This is done using hidden Markov model (HMM) control by allowing the policy to act over hidden states or noisy versions thereof while trying to maximize the probability of repeatedly having the desired observations. HMM control largely improves performance over the variational, or free energy, approach. We also show that the optimal policy is strictly deterministic, while the variational approach leads to a stochastic policy approximation. We finally provide a homeostatic reinterpretation of the maximum occupancy principle -a principle proposing that agents ought to maximize the occupancy of action-state path space -by defining homeostatic states as any states that do not immediately entail the termination or death of the agent.
ER -