The Forgotten History of Wave Function Variance Optimization and its Relevance for Neural-Network VMC
Abstract
We revisit the almost century-old question of which functional of the local energy best optimizes a trial wave function, a problem of central importance in Variational Monte Carlo (VMC) and, more recently, in Neural-Network VMC (NN-VMC). While variance optimization dates back to the 1930s, the high statistical noise and heavy-tailed local energy distributions inherent to modern neural-network wave functions have renewed interest in this approach. We retrace its long and largely forgotten history here, showing its direct relevance to modern Neural Quantum States (NQS) frameworks. Minimizing the variance (an L2 norm) implicitly assumes a Gaussian local energy distribution: an unjustified assumption. For Coulombic systems, the local energy distribution exhibits E−4 power-law tails, causing the Central Limit Theorem to fail for the variance estimator. This instability can be mitigated by robust cost functions: the Mean Absolute Deviation (MAD, an L1 norm), the Cauchy loss, or the L−4 functional, which features a tail analytically designed to match the E−4 exponent. We benchmark these functionals on H2+, an exactly solvable system at every internuclear distance, using the Guillemin-Zener wave function across the full potential energy curve. While energy minimization by construction yields the lowest energy, variance minimization is surpassed at every R by alternative functionals: MAD proves superior in the bonding region, while L−4 performs best in the dissociation regime.
Related
- Locality, Probability and the Relevance of History
- Percolation Dynamics in Optimization: Variance Cascades and Nested Symmetry
- Breaking the Shot-Noise Barrier: Cached Recycled Variance-Reduced Gradients for Quantum Optimization
- Single-eddy contributions to streamwise velocity variance in turbulent pipe flow. Part 1. The single-eddy intensity function
- Local optical feasibility maps for compound lens optimization under direct modulation transfer function constraints
BibTeX
@misc{bressanini2026forgotten,
title = {{The Forgotten History of Wave Function Variance Optimization and its Relevance for Neural-Network VMC}},
author = {Dario Bressanini},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.08453},
eprint = {2609.08453},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.08453},
}
RIS
TY - UNPB
TI - The Forgotten History of Wave Function Variance Optimization and its Relevance for Neural-Network VMC
AU - Dario Bressanini
PY - 2026
DA - 2026/09/08
PB - arXiv
DO - 10.48550/arxiv.2609.08453
UR - https://arxiv.org/abs/2609.08453
AB - We revisit the almost century-old question of which functional of the local energy best optimizes a trial wave function, a problem of central importance in Variational Monte Carlo (VMC) and, more recently, in Neural-Network VMC (NN-VMC). While variance optimization dates back to the 1930s, the high statistical noise and heavy-tailed local energy distributions inherent to modern neural-network wave functions have renewed interest in this approach. We retrace its long and largely forgotten history here, showing its direct relevance to modern Neural Quantum States (NQS) frameworks. Minimizing the variance (an L^2 norm) implicitly assumes a Gaussian local energy distribution: an unjustified assumption. For Coulombic systems, the local energy distribution exhibits E^−4 power-law tails, causing the Central Limit Theorem to fail for the variance estimator. This instability can be mitigated by robust cost functions: the Mean Absolute Deviation (MAD, an L^1 norm), the Cauchy loss, or the L_−4 functional, which features a tail analytically designed to match the E^−4 exponent. We benchmark these functionals on H_2^+, an exactly solvable system at every internuclear distance, using the Guillemin-Zener wave function across the full potential energy curve. While energy minimization by construction yields the lowest energy, variance minimization is surpassed at every R by alternative functionals: MAD proves superior in the bonding region, while L_−4 performs best in the dissociation regime.
ER -