Efficient Representation of multicategorical local Hilbert spaces: nonlinear Restricted Boltzmann Machines to Kolmogorov-Arnold Networks
Abstract
Neural network quantum states (NQS) for representing spin-1/2 systems are typically built from Multi-Layer Perceptrons (MLPs) with binary visible variables, in which the input spins are first combined through linear affine maps before more expressive nonlinear transformations are applied. The standard way for representing multi-categorical systems, namely spin-1 and spin-2, or the q-state quantum Potts systems with more than two local degrees of freedom, is a unary or one-hot encoded MLP architecture. Following a few similar studies, I observe that while the one-hot construction is the mathematically faithful encoding for systems with more than two local states such as spin-S models with S > 1/2 or q-state Potts models, its parameter count grows with the number of local states, and the resulting optimization landscape can hinder convergence. I find numerically that allowing log Ψ to be a nonlinear function of the raw multi-valued spin variable is a natural categorical generalization: it preserves the labelling freedom of the local basis and reproduces the one-hot model with strictly fewer parameters, often with improved trainability. I first benchmark this idea on shallow Restricted Boltzmann Machines (RBMs), equipping them with several distinct nonlinear connections, for spin-1, 2, and 3 Heisenberg chains. I then turn to Kolmogorov-Arnold Networks (KANs), where each edge carries a learnable univariate nonlinearity, and show that they provide a strictly more expressive realization of the same principle. Finally, I demonstrate that this framework captures the critical behaviour of the quantum Potts Hamiltonian, recovering its phase transition.
Related
- Algebraic Kolmogorov--Arnold representation theorem for quantum measurement
- Quantum Kolmogorov--Arnold representation theorem for continuous unitary-valued maps
- From Nonlinear Stochastic Differential Equations to Quantum Channels: The Kolmogorov--Lindblad Mapping
- Efficient Noise Context-Aware Representation for Low-Dose CT Denoising
- Singly resonant InGaP microresonators for efficient, low-threshold second-order nonlinear optics
BibTeX
@misc{lahiri2026efficient,
title = {{Efficient Representation of multicategorical local Hilbert spaces: nonlinear Restricted Boltzmann Machines to Kolmogorov-Arnold Networks}},
author = {Abhiroop Lahiri},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.06672},
eprint = {2609.06672},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.06672},
}
RIS
TY - UNPB
TI - Efficient Representation of multicategorical local Hilbert spaces: nonlinear Restricted Boltzmann Machines to Kolmogorov-Arnold Networks
AU - Abhiroop Lahiri
PY - 2026
DA - 2026/09/11
PB - arXiv
DO - 10.48550/arxiv.2609.06672
UR - https://arxiv.org/abs/2609.06672
AB - Neural network quantum states (NQS) for representing spin-1/2 systems are typically built from Multi-Layer Perceptrons (MLPs) with binary visible variables, in which the input spins are first combined through linear affine maps before more expressive nonlinear transformations are applied. The standard way for representing multi-categorical systems, namely spin-1 and spin-2, or the q-state quantum Potts systems with more than two local degrees of freedom, is a unary or one-hot encoded MLP architecture. Following a few similar studies, I observe that while the one-hot construction is the mathematically faithful encoding for systems with more than two local states such as spin-S models with S > 1/2 or q-state Potts models, its parameter count grows with the number of local states, and the resulting optimization landscape can hinder convergence. I find numerically that allowing log Ψ to be a nonlinear function of the raw multi-valued spin variable is a natural categorical generalization: it preserves the labelling freedom of the local basis and reproduces the one-hot model with strictly fewer parameters, often with improved trainability. I first benchmark this idea on shallow Restricted Boltzmann Machines (RBMs), equipping them with several distinct nonlinear connections, for spin-1, 2, and 3 Heisenberg chains. I then turn to Kolmogorov-Arnold Networks (KANs), where each edge carries a learnable univariate nonlinearity, and show that they provide a strictly more expressive realization of the same principle. Finally, I demonstrate that this framework captures the critical behaviour of the quantum Potts Hamiltonian, recovering its phase transition.
ER -