{
  "abstract": "Objectives involving quadratic forms $u^*f(A(θ))u$ for Hermitian $A$ arise widely in scientific computing and machine learning. Lanczos efficiently approximates these quantities, but differentiating through its recurrence can introduce numerical instability and costly reorthogonalization. Building on existing low-rank Krylov approximations of Fréchet derivatives, we develop a matrix-free gradient implementation that reuses the forward Lanczos quantities without differentiating through the recurrence. We analyze its discrepancy from the exact gradient of the finite Lanczos approximation, deriving an exact residual-coupled error identity and a bound involving the best degree-$(m-1)$ uniform polynomial approximation error of $f'$, multiplied by a basis-sensitivity factor. The discrepancy vanishes when the Krylov subspace is invariant. Experiments demonstrate accurate gradients and runtime improvements over differentiated-Lanczos and modified-Arnoldi baselines. It remains numerically stable without reorthogonalization in all tested settings, including cases where adjoint-based Lanczos differentiation becomes unstable.",
  "abstract_shown": true,
  "affiliations": [],
  "article_type": null,
  "arxiv": "2605.12801",
  "author_total": 3,
  "authors": [
    {
      "name": "Navjot Singh"
    },
    {
      "name": "Kipton Barros"
    },
    {
      "name": "Xiaoye Sherry Li"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/a4g3gtt03bbak.bib",
  "cited_by": 1,
  "doi": "10.48550/arxiv.2605.12801",
  "fulltext_url": null,
  "id": "a4g3gtt03bbak",
  "issns": [],
  "landing_url": "https://arxiv.org/abs/2605.12801",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "article",
  "licence_url": "http://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": "CC0-1.0",
  "native_subjects": [
    [
      "arxiv",
      "cs.NA"
    ],
    [
      "arxiv",
      "math.NA"
    ],
    [
      "openalex",
      "1703|Matrix Theory and Algorithms"
    ]
  ],
  "openalex": "W7161170896",
  "pdf_url": "https://arxiv.org/pdf/2605.12801",
  "pmcid": null,
  "pmid": null,
  "published": "2026-11-07",
  "publisher": null,
  "ris": "https://research.draconitic.com/paper/a4g3gtt03bbak.ris",
  "sources": [
    {
      "first_seen": "2026-11-10T06:21:33Z",
      "native_id": "2605.12801",
      "source": "arxiv",
      "url": "https://arxiv.org/abs/2605.12801"
    }
  ],
  "subjects": [
    {
      "field": "mathematics",
      "origin": "arxiv:math.NA",
      "subfield": "numerical-analysis"
    }
  ],
  "title": "Fast and Stable Gradient Approximation for Quadratic Forms of Hermitian Matrix Functions",
  "title_text": "Fast and Stable Gradient Approximation for Quadratic Forms of Hermitian Matrix Functions",
  "type": "preprint",
  "updated_at": "2026-11-12T06:20:38Z",
  "url": "https://research.draconitic.com/paper/a4g3gtt03bbak",
  "venue": "arXiv",
  "versions": []
}