Operator-valued free probability applied to recurrent neural networks with heterogeneity in local and global circuit structures
- 1University of Chicago
Abstract
Random connectivity is a common assumption in models of recurrent neural networks, yet biological circuits combine heterogeneous synaptic connections with organization into distinct anatomical regions and functional groups. How does this global structure interact with cellular and local circuit heterogeneity to shape the dimensionality of population activity? In our work, we use operator-valued free probability to derive the covariance spectrum and effective dimension of recurrent networks with heterogeneous gains and block-structured random connectivity. This framework handles the noncommuting matrix operations through which cellular and circuit heterogeneity jointly determine population variability. We show that the linear relationship between effective dimension and firing rate uniformity persists despite global connectivity structure. At fixed total connectivity variance and with identical firing rate distributions across areas, concentrating variance within one area decreases dimension, whereas concentrating it in directed connections between areas increases dimension. Together, these results establish a mechanistic connection between circuit organization and population dimensionality, and demonstrate how operator-valued free probability unifies cellular, local, and global sources of heterogeneity in recurrent networks.
Related
- Heterogeneous plasticity rules generate diverse structures in recurrent networks
- Reusable modular architecture enables flexible cognitive operations in the mouse brain and artificial recurrent networks
- CXCL9-Dependent Immune Networks of Spontaneous Tertiary Lymphoid Structures in a Murine Subcutaneous Tumor Model
- Disentangling Computation in Multi-Task Neural Networks with the Green's Operator
- Efficiency and robustness partition the solution space for memory in recurrent networks
BibTeX
@misc{jiang2026operatorvalued,
title = {{Operator-valued free probability applied to recurrent neural networks with heterogeneity in local and global circuit structures}},
author = {J. Jiang and G. Tian and B. Doiron},
howpublished = {bioRxiv},
year = {2026},
month = oct,
doi = {10.64898/2026.10.08.757745},
url = {https://www.biorxiv.org/content/10.64898/2026.10.08.757745v1},
note = {CC BY-NC-ND},
}
RIS
TY - UNPB
TI - Operator-valued free probability applied to recurrent neural networks with heterogeneity in local and global circuit structures
AU - J. Jiang
AU - G. Tian
AU - B. Doiron
PY - 2026
DA - 2026/10/08
PB - bioRxiv
DO - 10.64898/2026.10.08.757745
UR - https://www.biorxiv.org/content/10.64898/2026.10.08.757745v1
AB - Random connectivity is a common assumption in models of recurrent neural networks, yet biological circuits combine heterogeneous synaptic connections with organization into distinct anatomical regions and functional groups. How does this global structure interact with cellular and local circuit heterogeneity to shape the dimensionality of population activity? In our work, we use operator-valued free probability to derive the covariance spectrum and effective dimension of recurrent networks with heterogeneous gains and block-structured random connectivity. This framework handles the noncommuting matrix operations through which cellular and circuit heterogeneity jointly determine population variability. We show that the linear relationship between effective dimension and firing rate uniformity persists despite global connectivity structure. At fixed total connectivity variance and with identical firing rate distributions across areas, concentrating variance within one area decreases dimension, whereas concentrating it in directed connections between areas increases dimension. Together, these results establish a mechanistic connection between circuit organization and population dimensionality, and demonstrate how operator-valued free probability unifies cellular, local, and global sources of heterogeneity in recurrent networks.
ER -