PreprintCC BY 4.0HAL
Beyond the delta method
Abstract
We give an asymptotic development of the maximum likelihood estimator (MLE), or any other estimator defined implicitly, in a way which involves the limiting behavior of the score and its higher-order derivatives. This development, which is explicitly computable, gives some insights about the non-asymptotic behavior of the renormalized MLE and its departure from its limit. We highlight that the results hold whenever the score and its derivative converge, including to non Gaussian limits. Our approach is based on an asymptotic implicit function theorem, inspired from perturbative approaches.
Related
- A neural delta-f particle-in-cell method: evolving the background with learned backward flows
- Weighted spatial averages with missing observations: Convergence and accuracy of delta-method variance approximations
- Beyond Finite-Sum Optimization: A Primal-Dual Method for Decentralized Finite-Max Optimization
- Beyond Backpropagation: Monte Carlo Method Can Train Deep Neural Networks
- Beyond the Bochner Method: Optimal Spectral Gaps for Block Dynamics of Spin Systems like the O(N) Model
BibTeX
@misc{lejay2026beyond,
title = {{Beyond the delta method}},
author = {Antoine Lejay and Sara Mazzonetto},
howpublished = {HAL},
year = {2026},
month = sep,
eprint = {2207.13954},
archivePrefix = {arXiv},
url = {https://inria.hal.science/hal-03738371v5},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Beyond the delta method
AU - Antoine Lejay
AU - Sara Mazzonetto
PY - 2026
DA - 2026/09/22
PB - HAL
UR - https://inria.hal.science/hal-03738371v5
AB - We give an asymptotic development of the maximum likelihood estimator (MLE), or any other estimator defined implicitly, in a way which involves the limiting behavior of the score and its higher-order derivatives. This development, which is explicitly computable, gives some insights about the non-asymptotic behavior of the renormalized MLE and its departure from its limit. We highlight that the results hold whenever the score and its derivative converge, including to non Gaussian limits. Our approach is based on an asymptotic implicit function theorem, inspired from perturbative approaches.
ER -