{
  "abstract": "The singularities of a neurovariety have so far always turned out to lie at subnetworks: functions already computed by a smaller architecture of the same kind. This is what makes them readable as a bias of training towards simpler models, and whether they exhaust the singular locus is left open in the literature. We show that they do not. There are singular points at which every neuron is active, no two neurons are redundant, and the parametrisation is unramified, so that nothing visible at a single parameter signals the singularity. We call these exceptional, and we show that, after quotienting by the group of architectural symmetries, which acts freely on the full parameters, they can arise in only three ways: a rank drop of the differential of the parametrisation, a disconnected fibre, or a failure of properness. A small dimensional example is a fully connected network with two hidden layers of width two and quadratic activations. All the examples we produce are of the second kind, so that what fails at an exceptional singularity is not the simplicity of the model but the possibility of recovering the parameter, up to symmetry, from the function it computes.",
  "abstract_shown": true,
  "affiliations": [],
  "article_type": null,
  "arxiv": "2606.18440",
  "author_total": 1,
  "authors": [
    {
      "name": "Giacomo Graziani"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/3de8wavzxzwv7.bib",
  "cited_by": 0,
  "doi": "10.48550/arxiv.2606.18440",
  "fulltext_url": null,
  "id": "3de8wavzxzwv7",
  "issns": [],
  "landing_url": "https://arxiv.org/abs/2606.18440",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "article",
  "licence_url": "http://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": "CC0-1.0",
  "native_subjects": [
    [
      "arxiv",
      "math.AG"
    ],
    [
      "openalex",
      "1702|Neural Networks and Applications"
    ]
  ],
  "openalex": "W7165207306",
  "pdf_url": "https://arxiv.org/pdf/2606.18440",
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-09",
  "publisher": null,
  "ris": "https://research.draconitic.com/paper/3de8wavzxzwv7.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:28:40Z",
      "native_id": "2606.18440",
      "source": "arxiv",
      "url": "https://arxiv.org/abs/2606.18440"
    }
  ],
  "subjects": [
    {
      "field": "mathematics",
      "origin": "arxiv:math.AG",
      "subfield": "algebra-number-theory"
    }
  ],
  "title": "Exceptional Singularities in Polynomial Neural Networks",
  "title_text": "Exceptional Singularities in Polynomial Neural Networks",
  "type": "preprint",
  "updated_at": "2026-10-30T12:28:40Z",
  "url": "https://research.draconitic.com/paper/3de8wavzxzwv7",
  "venue": "arXiv",
  "versions": []
}