An Asymptotic Framework for Closed-Form Estimators from Surrogate Estimating Equations
Abstract
Many statistical estimators, including maximum likelihood and method of moments estimators, are defined as roots of estimating equations. In complex models, these equations often cannot be solved explicitly; although numerical methods can provide approximate solutions, closed-form approximations can reduce computation and facilitate theoretical analysis by making an estimator's dependence on the data more transparent. In this paper, we develop a general approach to constructing such approximations and a framework for quantifying their accuracy. Our theory accommodates sequences of parameters that approach the boundary of the parameter space or diverge to infinity, and provides conditions under which a closed-form approximate estimator has the same first-order asymptotic distribution as its exact counterpart. We focus on approximations to maximum likelihood estimators, although the theory applies to general estimating equations. We apply the framework to iid models from the gamma, zeta, von Mises, and generalized Pareto families, as well as to gamma regression. Together, these examples cover scalar and vector parameters, iid and non-iid settings, and normal and nonnormal asymptotic regimes. Each example is accompanied by a simulation study, and the gamma regression example also includes a real-world data application.
Related
- A Mathai-type Multivariate Nakagami-m Distribution: Density, Closed-form Estimators, and Asymptotic Efficiency
- Asymptotic Theory for Restricted Maximum Likelihood Estimators in Generalized Linear Mixed Models
- Matrix asymptotic calculus for plug-in maximum likelihood estimators in finite Markov chains
- On the Asymptotic Inadmissibility of Double Machine Learning Estimators Under Structure-Agnostic Models
- Algorithm-aware Statistical Inference in High-dimensional Estimating Equations
BibTeX
@misc{teplitsky2026asymptotic,
title = {{An Asymptotic Framework for Closed-Form Estimators from Surrogate Estimating Equations}},
author = {Yigal Teplitsky and Robert Zimmerman},
howpublished = {arXiv},
year = {2026},
month = nov,
doi = {10.48550/arxiv.2611.08746},
eprint = {2611.08746},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2611.08746},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - An Asymptotic Framework for Closed-Form Estimators from Surrogate Estimating Equations
AU - Yigal Teplitsky
AU - Robert Zimmerman
PY - 2026
DA - 2026/11/05
PB - arXiv
DO - 10.48550/arxiv.2611.08746
UR - https://arxiv.org/abs/2611.08746
AB - Many statistical estimators, including maximum likelihood and method of moments estimators, are defined as roots of estimating equations. In complex models, these equations often cannot be solved explicitly; although numerical methods can provide approximate solutions, closed-form approximations can reduce computation and facilitate theoretical analysis by making an estimator's dependence on the data more transparent. In this paper, we develop a general approach to constructing such approximations and a framework for quantifying their accuracy. Our theory accommodates sequences of parameters that approach the boundary of the parameter space or diverge to infinity, and provides conditions under which a closed-form approximate estimator has the same first-order asymptotic distribution as its exact counterpart. We focus on approximations to maximum likelihood estimators, although the theory applies to general estimating equations. We apply the framework to iid models from the gamma, zeta, von Mises, and generalized Pareto families, as well as to gamma regression. Together, these examples cover scalar and vector parameters, iid and non-iid settings, and normal and nonnormal asymptotic regimes. Each example is accompanied by a simulation study, and the gamma regression example also includes a real-world data application.
ER -