Physics-Informed Neural Networks for coupled stiff transport systems
Abstract
Physics-Informed Neural Networks (PINN) struggle with stiff, regime-changing transport equations due to instability, loss imbalance, and violations of physical consistency. This paper investigates these failures through the Marshak wave equations, a canonical benchmark from radiative transport, where initial and boundary conditions differ by up to 12 orders of magnitude, and proposes modifications to the standard PINN framework to overcome them. Three modifications are introduced: a ScaledSigmoid final activation enforcing physical bounds and positivity of the unknowns; a logarithmic MSE loss replacing the standard quadratic loss for initial and boundary conditions, enabling training across extreme scale disparities; and explicit enforcement of global conservation laws as an additional physics loss term. Monte Carlo sampling with exponential time weighting is used throughout. The proposed framework recovers the Marshak wave dynamics - including the hot, cold, and wave-front regions - in good agreement with a reference Implicit Monte Carlo solution (sub-millimeter absolute error on the front position, although the relative error remains substantial at early times), with run times under 5 minutes. Ablation studies confirm that each ingredient is essential: linear activation, absence of the logarithmic loss, or removal of the PDE term each independently cause the method to fail qualitatively. This work identifies and resolves three concrete failure modes of standard PINN on stiff hyperbolic systems with nonlinear coupling. The combination of bounded activations, scale-aware loss functions, and conservation law enforcement constitutes a framework validated on the present one-dimensional Marshak wave problem, with potential extension to other coupled stiff transport systems in engineering.
Versions
Related
- Lazy training of quantum physics informed neural networks
- AKAPINN: Adaptive Kolmogorov-Arnold Physics-Informed Neural Networks for approximating solutions to quasilinear partial differential equations
- Solving Fredholm Integral Equations with Physics-Informed Neural Networks: Single-and double-network approaches
- Error Estimates in Physics-Informed Neural Networks to Heat-Wave Fluid-Structure Interactive System
- Lie Symmetry-Guided Adaptive Sampling for Physics-Informed Neural Networks
BibTeX
@misc{laguzet2026physicsinformed,
title = {{Physics-Informed Neural Networks for coupled stiff transport systems}},
author = {Laetitia Laguzet and Gabriel Turinici},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2606.21236},
eprint = {2606.21236},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2606.21236},
note = {CC BY-NC-ND 4.0},
}
RIS
TY - UNPB
TI - Physics-Informed Neural Networks for coupled stiff transport systems
AU - Laetitia Laguzet
AU - Gabriel Turinici
PY - 2026
DA - 2026/10/26
PB - arXiv
DO - 10.48550/arxiv.2606.21236
UR - https://arxiv.org/abs/2606.21236
AB - Physics-Informed Neural Networks (PINN) struggle with stiff, regime-changing transport equations due to instability, loss imbalance, and violations of physical consistency. This paper investigates these failures through the Marshak wave equations, a canonical benchmark from radiative transport, where initial and boundary conditions differ by up to 12 orders of magnitude, and proposes modifications to the standard PINN framework to overcome them. Three modifications are introduced: a ScaledSigmoid final activation enforcing physical bounds and positivity of the unknowns; a logarithmic MSE loss replacing the standard quadratic loss for initial and boundary conditions, enabling training across extreme scale disparities; and explicit enforcement of global conservation laws as an additional physics loss term. Monte Carlo sampling with exponential time weighting is used throughout. The proposed framework recovers the Marshak wave dynamics - including the hot, cold, and wave-front regions - in good agreement with a reference Implicit Monte Carlo solution (sub-millimeter absolute error on the front position, although the relative error remains substantial at early times), with run times under 5 minutes. Ablation studies confirm that each ingredient is essential: linear activation, absence of the logarithmic loss, or removal of the PDE term each independently cause the method to fail qualitatively. This work identifies and resolves three concrete failure modes of standard PINN on stiff hyperbolic systems with nonlinear coupling. The combination of bounded activations, scale-aware loss functions, and conservation law enforcement constitutes a framework validated on the present one-dimensional Marshak wave problem, with potential extension to other coupled stiff transport systems in engineering.
ER -