On the role of error metrics in the assessment of chemical kinetic mechanisms
Abstract
Methods intended to decrease the computational cost of chemistry, such as mechanism reduction, neuralnetwork surrogates, or genetic optimization, rely on metrics to assess agreement with reference datasets. However, the role of error definitions in the design of these metrics remains poorly examined. This work presents a systematic analysis of error metrics and fitness functions commonly used for the assessment and optimization of chemical kinetic mechanisms. Fitness functions are constructed based on elementary design choices, including quantities of interest, error formulations, data transformations, and aggregation strategies. Their behavior is first analyzed a priori using controlled perturbations of time-resolved species profiles. The methodology is then evaluated using zero-dimensional ammonia/hydrogen combustion simulations, comparing detailed and reduced mechanisms. Novelty and significance statement The results demonstrate that standard relative-error metrics introduce significant biases across operating conditions. Conversely, an absolute error formulation applied to logarithmically transformed and min-max normalized profiles ensures a robust and consistent evaluation. This metric configuration is shown to be essential for genetic algorithms to converge toward highly accurate and generalizable reduced mechanisms. This work emphasizes the influence of the fitness function on the outcome of methods reducing the cost of chemistry integration, an aspect often treated as a secondary technical choice. By decomposing commonly used assessment criteria into elementary design features and analyzing their behavior under controlled perturbations, this study reveals fundamental sensitivities and biases that directly affect mechanism comparison and optimization outcomes. A key strength of this contribution lies in its generality: the proposed analysis and conclusions apply to reduction, optimization, and data-driven strategies alike.
Related
- Nitrogen-Centric Optimization of Polyamide Chemical Recycling: A Reaction Network Flux Analysis with New Metrics for Nitrogen Atom Economy and Nitrogen Footprint
- Mechanistic Elucidation of the Acidic Hydrolysis of Triazolobenzodiazepines: Integration of Kinetic, Thermodynamic, and Quantum Chemical Analyses
- Curvature-induced kinetic trapping in chemical reactions
- Geometric Reaction Path Alignment for Kinetic Feasibility Assessment
- Fluorescent Metal–Organic Frameworks for Chemical Sensing: Design Strategies, Mechanisms, and Analytical Applications
BibTeX
@article{kotlarczik2026role,
title = {{On the role of error metrics in the assessment of chemical kinetic mechanisms}},
author = {Martin Kotlarczik and Cédric Mehl and Damien Aubagnac and Lucia Giarracca-Mehl and Luc Vervisch},
journal = {Combustion and Flame},
year = {2026},
month = sep,
doi = {10.1016/j.combustflame.2026.115281},
url = {https://ifp.hal.science/hal-05773721v1},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - On the role of error metrics in the assessment of chemical kinetic mechanisms
AU - Martin Kotlarczik
AU - Cédric Mehl
AU - Damien Aubagnac
AU - Lucia Giarracca-Mehl
AU - Luc Vervisch
PY - 2026
DA - 2026/09/12
JO - Combustion and Flame
DO - 10.1016/j.combustflame.2026.115281
UR - https://ifp.hal.science/hal-05773721v1
AB - Methods intended to decrease the computational cost of chemistry, such as mechanism reduction, neuralnetwork surrogates, or genetic optimization, rely on metrics to assess agreement with reference datasets. However, the role of error definitions in the design of these metrics remains poorly examined. This work presents a systematic analysis of error metrics and fitness functions commonly used for the assessment and optimization of chemical kinetic mechanisms. Fitness functions are constructed based on elementary design choices, including quantities of interest, error formulations, data transformations, and aggregation strategies. Their behavior is first analyzed a priori using controlled perturbations of time-resolved species profiles. The methodology is then evaluated using zero-dimensional ammonia/hydrogen combustion simulations, comparing detailed and reduced mechanisms. Novelty and significance statement The results demonstrate that standard relative-error metrics introduce significant biases across operating conditions. Conversely, an absolute error formulation applied to logarithmically transformed and min-max normalized profiles ensures a robust and consistent evaluation. This metric configuration is shown to be essential for genetic algorithms to converge toward highly accurate and generalizable reduced mechanisms. This work emphasizes the influence of the fitness function on the outcome of methods reducing the cost of chemistry integration, an aspect often treated as a secondary technical choice. By decomposing commonly used assessment criteria into elementary design features and analyzing their behavior under controlled perturbations, this study reveals fundamental sensitivities and biases that directly affect mechanism comparison and optimization outcomes. A key strength of this contribution lies in its generality: the proposed analysis and conclusions apply to reduction, optimization, and data-driven strategies alike.
SN - 0010-2180
ER -