Benchmarking Optimizers to Solve Inverse Problems with Differentiable Physics Simulators
Abstract
Solving inverse problems with differentiable physics simulators holds the potential to revolutionize scientific discovery and engineering design, as it enjoys both the strict physical correctness from rigorous numerical physics simulators, and the high efficiency and effectiveness from automatic differentiation and gradient-based optimization. However, currently, this paradigm faces performance issues in optimization. In this work, we target benchmarking the performance of different optimizers to solve various inverse problems. We construct 12 differentiable physics simulators spanning physics domains including discrete mechanics, continuous mechanics, atomistic simulations, rendering, and semi-empirical physics models. Based on these simulators, we design corresponding inverse problems that can be categorized into parameter identification, inverse design, and optimal control. Finally, we conduct extensive experiments to compare the performance of different optimizers, including regular first-order methods, approximate second-order methods, as well as global optimizers, on these inverse problems, and analyze the results to provide insights on how to choose and design optimizers for differentiable programming. We hope such benchmarks can inspire the development of more effective optimizers, and further promote the applications of differentiable programming in various scientific and engineering domains.
Related
- KernelPack-JAX: a meshless differentiable GPU framework for node generation and forward and inverse PDE problems
- Differentiable FEM versus PINN for pavement layer inverse analysis: enforcing physics as hard or soft constraints
- IKLayer: A Differentiable Inverse Kinematics Layer for Whole-Body Control
- A Modal Approach to Solve Inverse Heat Conduction Problems
- Linear and non-linear thermal system identification based on the integral of non-integer order — Application to solve inverse heat conduction linear and non-linear problems
BibTeX
@misc{chen2026benchmarking,
title = {{Benchmarking Optimizers to Solve Inverse Problems with Differentiable Physics Simulators}},
author = {Xiang Chen and Huanhuan Xia},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.13819},
eprint = {2609.13819},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.13819},
note = {CC BY-NC-SA 4.0},
}
RIS
TY - UNPB
TI - Benchmarking Optimizers to Solve Inverse Problems with Differentiable Physics Simulators
AU - Xiang Chen
AU - Huanhuan Xia
PY - 2026
DA - 2026/09/12
PB - arXiv
DO - 10.48550/arxiv.2609.13819
UR - https://arxiv.org/abs/2609.13819
AB - Solving inverse problems with differentiable physics simulators holds the potential to revolutionize scientific discovery and engineering design, as it enjoys both the strict physical correctness from rigorous numerical physics simulators, and the high efficiency and effectiveness from automatic differentiation and gradient-based optimization. However, currently, this paradigm faces performance issues in optimization. In this work, we target benchmarking the performance of different optimizers to solve various inverse problems. We construct 12 differentiable physics simulators spanning physics domains including discrete mechanics, continuous mechanics, atomistic simulations, rendering, and semi-empirical physics models. Based on these simulators, we design corresponding inverse problems that can be categorized into parameter identification, inverse design, and optimal control. Finally, we conduct extensive experiments to compare the performance of different optimizers, including regular first-order methods, approximate second-order methods, as well as global optimizers, on these inverse problems, and analyze the results to provide insights on how to choose and design optimizers for differentiable programming. We hope such benchmarks can inspire the development of more effective optimizers, and further promote the applications of differentiable programming in various scientific and engineering domains.
ER -