Nonequivalence of expected free energy and revised system integrated information in noisy permutation networks
Abstract
The free-energy principle (FEP) and active inference describe adaptive systems through probabilistic generative models and free-energy functionals, whereas integrated information theory (IIT) characterizes intrinsic cause-effect organization. We separate two questions: whether revised IIT quantities admit local free-energy-like representations and whether scalar expected free energy can determine system integrated information. We show that the 2026 IIT intrinsic-differentiation and specification terms admit exact surprisal representations, and hence variational-free-energy representations under exact inference. We then construct noisy binary permutation networks whose causal topology varies while local transition reliability is fixed. In a homogeneous state, all permutations yield the same one-step predictive distribution and state-risk expected free energy under common preferences and observation models, yet revised IIT distinguishes them: multicycle permutations have zero whole-system integration, whereas a single noisy cycle has positive integration at intermediate reliability. For an n-unit noisy single cycle, we derive a closed-form expression for revised system integrated information, prove that the minimum-information partition cuts exactly two causal edges, and show that as n grows the optimal reliability approaches unity, the joint specified-state probability approaches one half, and the maximum integration approaches one ibit. Numerical IIT calculations for n = 2-5 and exhaustive partition enumeration through n = 8 reproduce the analytical results. Thus, local surprisal/free-energy correspondence coexists with global non-equivalence: equal expected free energy does not imply equal revised IIT system integrated information. Any synthesis of IIT with FEP/active inference must retain counterfactual causal information beyond a scalar free-energy value.
Related
- An Integrative Theory of the Noradrenaline System: Meta-Control through Expected Information Gain
- Permutation theory governs long-term dynamics of critical Boolean networks
- Existence of an infinite family of substrates satisfying all the postulates of integrated information theory, exclusion included, with arbitrarily large integrated information
- The consciousness-first commitment of integrated information theory.
- Redundant information across functionally coupled cortical networks supports rapid perceptual decisions in the ferret
BibTeX
@misc{tanabe2026nonequivalence,
title = {{Nonequivalence of expected free energy and revised system integrated information in noisy permutation networks}},
author = {Katsuaki Tanabe},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.03735},
eprint = {2610.03735},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.03735},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Nonequivalence of expected free energy and revised system integrated information in noisy permutation networks
AU - Katsuaki Tanabe
PY - 2026
DA - 2026/10/01
PB - arXiv
DO - 10.48550/arxiv.2610.03735
UR - https://arxiv.org/abs/2610.03735
AB - The free-energy principle (FEP) and active inference describe adaptive systems through probabilistic generative models and free-energy functionals, whereas integrated information theory (IIT) characterizes intrinsic cause-effect organization. We separate two questions: whether revised IIT quantities admit local free-energy-like representations and whether scalar expected free energy can determine system integrated information. We show that the 2026 IIT intrinsic-differentiation and specification terms admit exact surprisal representations, and hence variational-free-energy representations under exact inference. We then construct noisy binary permutation networks whose causal topology varies while local transition reliability is fixed. In a homogeneous state, all permutations yield the same one-step predictive distribution and state-risk expected free energy under common preferences and observation models, yet revised IIT distinguishes them: multicycle permutations have zero whole-system integration, whereas a single noisy cycle has positive integration at intermediate reliability. For an n-unit noisy single cycle, we derive a closed-form expression for revised system integrated information, prove that the minimum-information partition cuts exactly two causal edges, and show that as n grows the optimal reliability approaches unity, the joint specified-state probability approaches one half, and the maximum integration approaches one ibit. Numerical IIT calculations for n = 2-5 and exhaustive partition enumeration through n = 8 reproduce the analytical results. Thus, local surprisal/free-energy correspondence coexists with global non-equivalence: equal expected free energy does not imply equal revised IIT system integrated information. Any synthesis of IIT with FEP/active inference must retain counterfactual causal information beyond a scalar free-energy value.
ER -