A gradient-enhanced physics-informed neural network with adaptive loss weighting for high-dimensional non-linear sine-Gordon problems
- 1Department of Applied Mathematics, College of Applied Natural Science, Adama Science and Technology University
Abstract
This paper proposes a modified physics-informed neural network (PINN), known as Adaptive Weighted Loss Gradient-Enhanced PINNs (AWL-gPINNs) to the numerical approximation of high-dimensional nonlinear sine-Gordon equations (SGEs). The proposed algorithm is an extension of the typical PINN formulation, i.e. it adds gradient-based residual constraints and an adaptive weighting strategy in order to balance the importance of PDE residual terms, initial conditions, and boundary conditions in training. The existing governing SGE is reduced to a coupled first-order form, which allows the automatic differentiation to be easily integrated to evaluate higher-order derivatives. The resulting composite loss functional consists of the residual and gradient-regularization terms that have trainable weights, which reduce the issue of stiffness and imbalance in multi-objective optimization. Benchmark problems of 3D to 20D damped and undamped SGEs in both long and short time domains are extensively numerically experimented with. The findings show that AWL-gPINNs perform much better than standard PINNs and a variety of existing algorithms and obtain orders of error reduction between 1e-3 -1e-2 and 1e-5-1e-4. The technique also demonstrates rapid convergence, increased training robustness, and stability across different collocation densities, noise perturbations, and initialization conditions. Moreover, when the proposed method is compared to state-of-the-art variants of PINN, it is established that the method is superior to the current methods in a variety of high-dimensional PDEs with very small error magnitudes, even in the 20D case. The efficacy, robustness, and practical efficiency of the suggested AWL-gPINN framework for high-dimensional nonlinear SGE are further validated by ablation studies and multi-seed stability assessments. The results support that the proposed AWL-gPINNs is a scalable and successful technique for high-dimensional nonlinear PDE solutions.
Related
- SDF-Aware Weighting: Adaptive Eikonal Regularisation for Three-Dimensional Level-Set Physics-Informed Neural Networks
- Physics-informed neural networks by Gradient-Guided Gaussian Adaptive Sampling (3GAS-PINNs)
- Mass weighting algorithm optimizes Fourier-based physics-informed neural network in adhesive contact mechanics
- Hybrid Variational Quantum-Classical Framework with Adaptive Weighting and Efficiency Assessment
- Atomic density optimization of quasi-one-dimensional diffuse laser cooling under a two-dimensional magnetic-field gradient
BibTeX
@article{deresse2026gradientenhanced,
title = {{A gradient-enhanced physics-informed neural network with adaptive loss weighting for high-dimensional non-linear sine-Gordon problems}},
author = {Alemayehu Tamirie Deresse and Tamirat Temesgen Dufera},
journal = {Scientific Reports},
year = {2026},
month = jul,
doi = {10.1038/s41598-026-63113-x},
url = {https://doi.org/10.1038/s41598-026-63113-x},
note = {CC BY},
}
RIS
TY - JOUR
TI - A gradient-enhanced physics-informed neural network with adaptive loss weighting for high-dimensional non-linear sine-Gordon problems
AU - Alemayehu Tamirie Deresse
AU - Tamirat Temesgen Dufera
PY - 2026
DA - 2026/07/01
JO - Scientific Reports
DO - 10.1038/s41598-026-63113-x
UR - https://doi.org/10.1038/s41598-026-63113-x
AB - This paper proposes a modified physics-informed neural network (PINN), known as Adaptive Weighted Loss Gradient-Enhanced PINNs (AWL-gPINNs) to the numerical approximation of high-dimensional nonlinear sine-Gordon equations (SGEs). The proposed algorithm is an extension of the typical PINN formulation, i.e. it adds gradient-based residual constraints and an adaptive weighting strategy in order to balance the importance of PDE residual terms, initial conditions, and boundary conditions in training. The existing governing SGE is reduced to a coupled first-order form, which allows the automatic differentiation to be easily integrated to evaluate higher-order derivatives. The resulting composite loss functional consists of the residual and gradient-regularization terms that have trainable weights, which reduce the issue of stiffness and imbalance in multi-objective optimization. Benchmark problems of 3D to 20D damped and undamped SGEs in both long and short time domains are extensively numerically experimented with. The findings show that AWL-gPINNs perform much better than standard PINNs and a variety of existing algorithms and obtain orders of error reduction between 1e-3 -1e-2 and 1e-5-1e-4. The technique also demonstrates rapid convergence, increased training robustness, and stability across different collocation densities, noise perturbations, and initialization conditions. Moreover, when the proposed method is compared to state-of-the-art variants of PINN, it is established that the method is superior to the current methods in a variety of high-dimensional PDEs with very small error magnitudes, even in the 20D case. The efficacy, robustness, and practical efficiency of the suggested AWL-gPINN framework for high-dimensional nonlinear SGE are further validated by ablation studies and multi-seed stability assessments. The results support that the proposed AWL-gPINNs is a scalable and successful technique for high-dimensional nonlinear PDE solutions.
SN - 2045-2322
ER -