From exact gradients to exact standard errors: third- and fourth-order sensitivities for the Laplacian population likelihood family
- 1Division of Systems Pharmacology and Pharmacy, Leiden Academic Centre for Drug Research, Leiden University, Leiden, The Netherlands
Abstract
Asymptotic standard errors for the parameters of a nonlinear mixed effects model fitted by Laplacian estimation, first-order conditional estimation (FOCE), or FOCE with interaction (FOCEI) require the observed (Fisher) information, the negative second derivative of the population objective at the optimum. The gradient of this objective can be computed exactly from sensitivity equations, but the observed information is still formed by finite differencing, which is less accurate, step-size dependent, and requires empirical Bayes reoptimization. These perturbed individual optimization problems can fail even after a successful fit. Our objectives are to (1) extend the exact-gradient sensitivity framework by one differentiation and give the observed information of the Laplacian population likelihood family in closed form and (2) illustrate covariance calculation without further empirical Bayes optimization in a case example. Writing the objective as a data term plus the log-determinant of the inner Hessian, the population Hessian splits so that the data term reuses second-order sensitivities, whereas the log determinant term requires third-order sensitivities for FOCE/FOCEI and fourth-order sensitivities for the full Laplacian method. We illustrate this on a two-compartment oral model with first-order absorption fitted to simulated data. The analytic covariance involves no differencing step and uses the fitted empirical Bayes estimates without reoptimization, avoiding this source of covariance-step failure. Implemented for FOCE/FOCEI in the open-source R package nlmixr2, the construction provides exact, reproducible standard errors for the approximate likelihood, limited by numerical solution accuracy and conditioning. This supports more dependable confidence intervals, identifiability assessment, and uncertainty propagation.
Related
- Art, normality and sensitivities: artistic workshops as spaces of expression for young people and adults with intellectual disabilities in Córdoba, Argentina
- Large-scale compound screening reveals sensitivities to SM1-71, HDACs/mTOR Inhibitor 1, BGT226, and ON013100 in glioma.
- Progress but not on track: forecasting under-five mortality and the likelihood of achieving SDG target 3.2 in Southern Africa
- Modeling heart failure with preserved ejection fraction (HFpEF) likelihood among women with suspected coronary microvascular dysfunction (CMD)
- Stochastic SEIR dynamics via graph Laplacian diffusion under transmission uncertainty
BibTeX
@misc{beek2026from,
title = {{From exact gradients to exact standard errors: third- and fourth-order sensitivities for the Laplacian population likelihood family}},
author = {H. van de Beek and M. Beldjenna and J. Almquist and M. L. Fidler and L. B. Zwep and J. G. C. van Hasselt},
howpublished = {bioRxiv},
year = {2026},
month = jul,
doi = {10.64898/2026.07.09.737434},
url = {https://www.biorxiv.org/content/10.64898/2026.07.09.737434v2},
note = {CC BY},
}
RIS
TY - UNPB
TI - From exact gradients to exact standard errors: third- and fourth-order sensitivities for the Laplacian population likelihood family
AU - H. van de Beek
AU - M. Beldjenna
AU - J. Almquist
AU - M. L. Fidler
AU - L. B. Zwep
AU - J. G. C. van Hasselt
PY - 2026
DA - 2026/07/09
PB - bioRxiv
DO - 10.64898/2026.07.09.737434
UR - https://www.biorxiv.org/content/10.64898/2026.07.09.737434v2
AB - Asymptotic standard errors for the parameters of a nonlinear mixed effects model fitted by Laplacian estimation, first-order conditional estimation (FOCE), or FOCE with interaction (FOCEI) require the observed (Fisher) information, the negative second derivative of the population objective at the optimum. The gradient of this objective can be computed exactly from sensitivity equations, but the observed information is still formed by finite differencing, which is less accurate, step-size dependent, and requires empirical Bayes reoptimization. These perturbed individual optimization problems can fail even after a successful fit. Our objectives are to (1) extend the exact-gradient sensitivity framework by one differentiation and give the observed information of the Laplacian population likelihood family in closed form and (2) illustrate covariance calculation without further empirical Bayes optimization in a case example. Writing the objective as a data term plus the log-determinant of the inner Hessian, the population Hessian splits so that the data term reuses second-order sensitivities, whereas the log determinant term requires third-order sensitivities for FOCE/FOCEI and fourth-order sensitivities for the full Laplacian method. We illustrate this on a two-compartment oral model with first-order absorption fitted to simulated data. The analytic covariance involves no differencing step and uses the fitted empirical Bayes estimates without reoptimization, avoiding this source of covariance-step failure. Implemented for FOCE/FOCEI in the open-source R package nlmixr2, the construction provides exact, reproducible standard errors for the approximate likelihood, limited by numerical solution accuracy and conditioning. This supports more dependable confidence intervals, identifiability assessment, and uncertainty propagation.
ER -