Evaluating CMAQ Representation of Wildfire PM₂.₅ in California (2008–2018): Regime-Dependent Performance and Nonlinear Error Structure
Abstract
We evaluated daily paired Community Multiscale Air Quality (CMAQ) estimates and observations during California fire seasons (June–October), 2008–2018, using conventional metrics, classifications at 12 and 35 µg m⁻³, two case studies, and a leakage-resistant Random Forest diagnostic. After quarantining 18 CMAQ total PM₂.₅ values above 557 µg m⁻³ without capping, the primary analysis contained 187,051 records. Observed and modeled means were 10.69 and 9.29 µg m⁻³; Pearson r was 0.502 (r² = 0.252), mean bias was − 1.40 µg m⁻³, and RMSE was 9.96 µg m⁻³. CMAQ detected 45.4% of observed events at the descriptive/former annual level of 12 µg m⁻³ and 40.8% at the current 35 µg m⁻³ 24-hour standard level. At 35 µg m⁻³, CMAQ produced more events overall but missed 1,273 of 2,151 observed events because modeled and observed events often did not coincide by site-day. The Random Forest excluded observed PM₂.₅, CMAQ total PM₂.₅, and the no-fire component from its primary features. In an untouched site-year test partition (n = 37,430), R² was 0.711, RMSE was 5.82 µg m⁻³, and MAE was 3.44 µg m⁻³; fire-only CMAQ PM₂.₅ was the dominant predictor. CMAQ remains useful for regional and multi-year analyses, but paired-event detection and localized extreme-smoke estimates require explicit uncertainty treatment.
Related
- Evaluating the performance of the surface water and ocean topography (SWOT) mission for monitoring reservoirs across the conterminous United States
- In Situ Reproductive Bioassay with Caged Gammarus fossarum (Crustacea): Part 2—Evaluating the Relevance of Using a Molt Cycle Temperature‐Dependent Model as a Reference to Assess Toxicity in Freshwater Monitoring
- Evaluating the performance and reliability of CA-Markov and CA-ANN models for land use/land cover change simulation in Southwestern Nigeria
- ADEPTS: An auto-differentiable framework for time-dependent nonlinear thermo-chemical mantle convection inversion
- Comparison of two methods for evaluating the performance of particle filtration systems in underground railway stations
BibTeX
@misc{bonilla2026evaluating,
title = {{Evaluating CMAQ Representation of Wildfire PM₂.₅ in California (2008–2018): Regime-Dependent Performance and Nonlinear Error Structure}},
author = {Eimy X. Bonilla and Jose Perez-Chavez and Daja Elum and Olutoyosi Oyelowo and Samuel Kane and Rachel E. Connolly and Miriam E. Marlier and Jihoon Jung and Mohammad Al-Hamdan and Claire L. Schollaert and John C. Flunker and Huikyo Lee and Sambit Bhattacharya and Osinachi Ajoku and Christopher Blaszczak-Boxe and Joseph L. Wilkins},
howpublished = {Research Square},
year = {2026},
month = nov,
doi = {10.21203/rs.3.rs-11167409/v1},
url = {https://doi.org/10.21203/rs.3.rs-11167409/v1},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Evaluating CMAQ Representation of Wildfire PM₂.₅ in California (2008–2018): Regime-Dependent Performance and Nonlinear Error Structure
AU - Eimy X. Bonilla
AU - Jose Perez-Chavez
AU - Daja Elum
AU - Olutoyosi Oyelowo
AU - Samuel Kane
AU - Rachel E. Connolly
AU - Miriam E. Marlier
AU - Jihoon Jung
AU - Mohammad Al-Hamdan
AU - Claire L. Schollaert
AU - John C. Flunker
AU - Huikyo Lee
AU - Sambit Bhattacharya
AU - Osinachi Ajoku
AU - Christopher Blaszczak-Boxe
AU - Joseph L. Wilkins
PY - 2026
DA - 2026/11/01
PB - Research Square
DO - 10.21203/rs.3.rs-11167409/v1
UR - https://doi.org/10.21203/rs.3.rs-11167409/v1
AB - We evaluated daily paired Community Multiscale Air Quality (CMAQ) estimates and observations during California fire seasons (June–October), 2008–2018, using conventional metrics, classifications at 12 and 35 µg m⁻³, two case studies, and a leakage-resistant Random Forest diagnostic. After quarantining 18 CMAQ total PM₂.₅ values above 557 µg m⁻³ without capping, the primary analysis contained 187,051 records. Observed and modeled means were 10.69 and 9.29 µg m⁻³; Pearson r was 0.502 (r² = 0.252), mean bias was − 1.40 µg m⁻³, and RMSE was 9.96 µg m⁻³. CMAQ detected 45.4% of observed events at the descriptive/former annual level of 12 µg m⁻³ and 40.8% at the current 35 µg m⁻³ 24-hour standard level. At 35 µg m⁻³, CMAQ produced more events overall but missed 1,273 of 2,151 observed events because modeled and observed events often did not coincide by site-day. The Random Forest excluded observed PM₂.₅, CMAQ total PM₂.₅, and the no-fire component from its primary features. In an untouched site-year test partition (n = 37,430), R² was 0.711, RMSE was 5.82 µg m⁻³, and MAE was 3.44 µg m⁻³; fire-only CMAQ PM₂.₅ was the dominant predictor. CMAQ remains useful for regional and multi-year analyses, but paired-event detection and localized extreme-smoke estimates require explicit uncertainty treatment.
SN - 2693-5015
ER -