Kaya-guided hybrid deep learning for leave-country-out estimation of national CO2 emissions: a 112-country benchmark with country-clustered inference, conformal uncertainty, and explainable AI
Abstract
Reliable national CO2 inventories underpin the Paris Agreement’s Enhanced Transparency 1national emissions modelling as leave-country-out (LOCO) estimation: predicting a country’s per-capita CO2 from eight-year trajectories of energy and socioeconomic covariates, with no access to its own emission history. Using Global Carbon Budget and Energy Institute data harmonized by Our World in Data, we build a 112-country panel (1990-2023; 3,024 windowed samples) and benchmark thirteen models under country-disjoint five-fold cross-validation. The proposed Kaya-guided CNN-BiLSTM-Attention network (KG-CBA) couples a log-linear backbone motivated by the Kaya identity to a convolutional-recurrent-attention branch that learns only the nonlinear residual, tuned by particle swarm optimization. Because the sample contains 27 repeated years per country, all inference is country-clustered. Kaya guidance significantly improves the unguided architecture (median APE 15.7% vs 20.8%, p = 0.002), and ridge regression significantly outperforms every tree ensemble and every unguided deep network; but the best ensemble’s apparent edge over ridge is not significant (15.1% vs 16.3%, p = 0.22), where observation-level testing would report p < 10-9. Error is highly concentrated: six structurally atypical energy systems contribute 79-84% of total squared error. Adding the low-carbon energy share on a 76-country sub-panel halves median error (7.35% vs 13.72% like-for-like), showing that energy-mix data availability, not model sophistication, is the binding constraint. Removing all CO2-derived covariates costs under one percentage point, so the estimator suits countries with no inventory at all. Split-conformal Monte-Carlo-dropout intervals reach 81.9% coverage at a 90% nominal level, the shortfall traced to non-exchangeability under grouped splits. In conventional temporal forecasting, learners beat naive persistence only marginally and inconsistently across evaluation windows. Data and code are open.
Related
- Investigating variability and uncertainty in upstream methane emissions intensity estimates of Western Canadian oil and gas production
- Advancing Near-Term Water Quality Forecasting with Explainable Machine Learning and Probabilistic Uncertainty Quantification
- Quantifying and attributing CO emissions over Central Asia using TROPOMI and explicit observational uncertainty
- Explainable and Uncertainty-Aware Computational Geodetic Inversion: A Review and Framework for Multi-Source Earth Observation
- Bottom-up estimation of CO2 emissions from container ships: a proof of concept using real operational data on the Brazil–Asia route
BibTeX
@misc{atuahene2026kayaguided,
title = {{Kaya-guided hybrid deep learning for leave-country-out estimation of national CO2 emissions: a 112-country benchmark with country-clustered inference, conformal uncertainty, and explainable AI}},
author = {SAMIUEL C. ATUAHENE and Bismark Boateng and Hilda Amarfio and Ekow Yaleh Quayson and Francis Boateng Agyenim},
howpublished = {EarthArXiv},
year = {2026},
month = sep,
doi = {10.31223/x5g80h},
url = {https://eartharxiv.org/repository/view/14906/},
note = {CC BY 4.0},
}
RIS
TY - UNPB
TI - Kaya-guided hybrid deep learning for leave-country-out estimation of national CO2 emissions: a 112-country benchmark with country-clustered inference, conformal uncertainty, and explainable AI
AU - SAMIUEL C. ATUAHENE
AU - Bismark Boateng
AU - Hilda Amarfio
AU - Ekow Yaleh Quayson
AU - Francis Boateng Agyenim
PY - 2026
DA - 2026/09/09
PB - EarthArXiv
DO - 10.31223/x5g80h
UR - https://eartharxiv.org/repository/view/14906/
AB - Reliable national CO2 inventories underpin the Paris Agreement’s Enhanced Transparency 1national emissions modelling as leave-country-out (LOCO) estimation: predicting a country’s per-capita CO2 from eight-year trajectories of energy and socioeconomic covariates, with no access to its own emission history. Using Global Carbon Budget and Energy Institute data harmonized by Our World in Data, we build a 112-country panel (1990-2023; 3,024 windowed samples) and benchmark thirteen models under country-disjoint five-fold cross-validation. The proposed Kaya-guided CNN-BiLSTM-Attention network (KG-CBA) couples a log-linear backbone motivated by the Kaya identity to a convolutional-recurrent-attention branch that learns only the nonlinear residual, tuned by particle swarm optimization. Because the sample contains 27 repeated years per country, all inference is country-clustered. Kaya guidance significantly improves the unguided architecture (median APE 15.7% vs 20.8%, p = 0.002), and ridge regression significantly outperforms every tree ensemble and every unguided deep network; but the best ensemble’s apparent edge over ridge is not significant (15.1% vs 16.3%, p = 0.22), where observation-level testing would report p < 10-9. Error is highly concentrated: six structurally atypical energy systems contribute 79-84% of total squared error. Adding the low-carbon energy share on a 76-country sub-panel halves median error (7.35% vs 13.72% like-for-like), showing that energy-mix data availability, not model sophistication, is the binding constraint. Removing all CO2-derived covariates costs under one percentage point, so the estimator suits countries with no inventory at all. Split-conformal Monte-Carlo-dropout intervals reach 81.9% coverage at a 90% nominal level, the shortfall traced to non-exchangeability under grouped splits. In conventional temporal forecasting, learners beat naive persistence only marginally and inconsistently across evaluation windows. Data and code are open.
ER -