Skip to content
DraconiticResearch
Search Sources API
185,139 studies31 sourcesUpdated 47 min ago
PreprintCC BY-NC-SA 4.0arXiv

On the identifiability and semi-algebraicity of ReLU neuromanifolds

Abstract

We study several aspects of the semi-algebraicity of the neuromanifold ℳd of a feedforward ReLU neural network. We prove that ℳd in general is not a semi-algebraic quotient of the space of parameters of the network, but it can be approximated (in a precise sense) by semi-algebraic spaces. We then consider the notion of identifiable subsets of the space of parameters, where the network does not have any hidden symmetries. We prove that the maximal identifiable subset is semi-algebraic for any neural network with semi-algebraic activation functions. Lastly, we compute explicitly the identifiable subset of a shallow ReLU network and prove that for input dimensions ≥ 3 and width ≥ 6 it is not euclidean open.

Related

  1. Adams Spectral Sequences and Franke’s Algebraicity Conjecture
    Irakli Patchkoria, Piotr Pstrągowski
    Memoirs of the American Mathematical SocietyPeer-reviewedLicence not statedFull text11 citedMathematical physicsOpenAlex
  2. Non-algebraicity of the Lawson surfaces ξk,l
    Lynn Heller, Sebastian Heller
    arXivPreprintCC BY 4.0Full textAlgebra & number theoryGeometry & topologyarXiv
  3. Non-algebraicity of Deligne--Hitchin twistor spaces
    Pengfei Huang
    arXivPreprintCC BY 4.0Full textAlgebra & number theoryarXiv
  4. S-integrality for families of ordinary K3 surfaces and algebraicity theorems
    Ruofan Jiang, Ananth N. Shankar
    arXivPreprintCC BY 4.0Full textAlgebra & number theoryarXiv
  5. Algebraicity, Hodge Gradings, and the Geometry of Period Images
    Kefeng Liu, Yang Shen
    arXivPreprintarXiv licenceFull textAlgebra & number theoryarXiv
BibTeX
@misc{flinth2026identifiability,
  title = {{On the identifiability and semi-algebraicity of ReLU neuromanifolds}},
  author = {Axel Flinth and Stefano Mereta and Michele Pernice},
  howpublished = {arXiv},
  year = {2026},
  month = oct,
  doi = {10.48550/arxiv.2606.02826},
  eprint = {2606.02826},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2606.02826},
  note = {CC BY-NC-SA 4.0},
}
RIS
TY  - UNPB
TI  - On the identifiability and semi-algebraicity of ReLU neuromanifolds
AU  - Axel Flinth
AU  - Stefano Mereta
AU  - Michele Pernice
PY  - 2026
DA  - 2026/10/15
PB  - arXiv
DO  - 10.48550/arxiv.2606.02826
UR  - https://arxiv.org/abs/2606.02826
AB  - We study several aspects of the semi-algebraicity of the neuromanifold ℳ_d of a feedforward ReLU neural network. We prove that ℳ_d in general is not a semi-algebraic quotient of the space of parameters of the network, but it can be approximated (in a precise sense) by semi-algebraic spaces. We then consider the notion of identifiable subsets of the space of parameters, where the network does not have any hidden symmetries. We prove that the maximal identifiable subset is semi-algebraic for any neural network with semi-algebraic activation functions. Lastly, we compute explicitly the identifiable subset of a shallow ReLU network and prove that for input dimensions ≥ 3 and width ≥ 6 it is not euclidean open.
ER  -