Hallucination in Time-series Large Language Models: An empirical lnvestigation and analysis of mitigation strategies
- 1Department of Computing, Faculty of Management, Science and Computing, Universiti Teknologi PETRONAS
- 2College of Computer Science and Engineering, University of Hafr Batin
- 3Department of Computer Science, Aliko Dangote University of Science and Technology
Abstract
Large Language Models (LLMs) are increasingly being applied to time-series forecasting, giving rise to a class of models referred to as time-series LLMs. While these models achieve competitive predictive accuracy, their reliability and structural consistency remain insufficiently understood. These models may produce forecasts that are numerically accurate on average yet statistically or temporally implausible, a phenomenon referred to as hallucination. Unlike conventional forecasting errors, hallucinations represent deviations from underlying temporal dynamics that exceed expected volatility patterns. This paper presents a systematic investigation of hallucination in time-series LLM forecasting. We introduce a quantitative evaluation framework that complements traditional regression metrics with two reliability-oriented measures: perplexity (PP), which reflects predictive uncertainty, and hallucination rate (HR), which measures statistically significant deviations from ground truth. Experiments on widely used benchmark datasets (Electricity and ETT variants) reveal a critical trade-off between forecasting accuracy and reliability. In several settings, improvements in average error metrics do not correspond to improved reliability; models can maintain low mean absolute error (MAE) while exhibiting high HR. To mitigate this issue, we evaluate two strategies: data-centric preprocessing, whose effectiveness depends on dataset characteristics, and structured tokenization, which consistently reduces hallucination across the evaluated datasets. Sensitivity analysis over quantile thresholds confirms the robustness of hallucination trends and model rankings. These results demonstrate that conventional regression metrics alone are insufficient for evaluating time-series LLMs and highlight the need for reliability-focused diagnostics when deploying LLM-based forecasting systems in high-stakes domains.
Related
- HalluciGuard-eye: knowledge graph-enhanced retrieval-augmented generation for hallucination detection and mitigation in ophthalmic multimodal large language models
- Severity Stratification Changes What Hallucination Rates Mean: An Item-Matched Audit of Five Large Language Models in Orthodontic Decision Support.
- Four large language models in parent-oriented education for pediatric flexible flatfoot: Quality, readability, hallucination, and reproducibility
- Performance and Hallucination Analysis of Large Language Models on European Anesthesiology Examinations: Cross-Sectional Comparative Study
- Molecular Mechanisms and Developmental Effects of Endocrine Disruptors on Male Reproductive Health and Mitigation Strategies to Reduce Their Adverse Effects.
BibTeX
@article{abdullahi2026hallucination,
title = {{Hallucination in Time-series Large Language Models: An empirical lnvestigation and analysis of mitigation strategies}},
author = {Shamsu Abdullahi and Kamaluddeen Usman Danyaro and Haruna Chiroma and Tieng Wei Koh and Abubakar Zakari and Yusuf Aliyu},
journal = {Scientific Reports},
year = {2026},
month = jul,
doi = {10.1038/s41598-026-62952-y},
url = {https://doi.org/10.1038/s41598-026-62952-y},
note = {CC BY},
}
RIS
TY - JOUR
TI - Hallucination in Time-series Large Language Models: An empirical lnvestigation and analysis of mitigation strategies
AU - Shamsu Abdullahi
AU - Kamaluddeen Usman Danyaro
AU - Haruna Chiroma
AU - Tieng Wei Koh
AU - Abubakar Zakari
AU - Yusuf Aliyu
PY - 2026
DA - 2026/07/01
JO - Scientific Reports
DO - 10.1038/s41598-026-62952-y
UR - https://doi.org/10.1038/s41598-026-62952-y
AB - Large Language Models (LLMs) are increasingly being applied to time-series forecasting, giving rise to a class of models referred to as time-series LLMs. While these models achieve competitive predictive accuracy, their reliability and structural consistency remain insufficiently understood. These models may produce forecasts that are numerically accurate on average yet statistically or temporally implausible, a phenomenon referred to as hallucination. Unlike conventional forecasting errors, hallucinations represent deviations from underlying temporal dynamics that exceed expected volatility patterns. This paper presents a systematic investigation of hallucination in time-series LLM forecasting. We introduce a quantitative evaluation framework that complements traditional regression metrics with two reliability-oriented measures: perplexity (PP), which reflects predictive uncertainty, and hallucination rate (HR), which measures statistically significant deviations from ground truth. Experiments on widely used benchmark datasets (Electricity and ETT variants) reveal a critical trade-off between forecasting accuracy and reliability. In several settings, improvements in average error metrics do not correspond to improved reliability; models can maintain low mean absolute error (MAE) while exhibiting high HR. To mitigate this issue, we evaluate two strategies: data-centric preprocessing, whose effectiveness depends on dataset characteristics, and structured tokenization, which consistently reduces hallucination across the evaluated datasets. Sensitivity analysis over quantile thresholds confirms the robustness of hallucination trends and model rankings. These results demonstrate that conventional regression metrics alone are insufficient for evaluating time-series LLMs and highlight the need for reliability-focused diagnostics when deploying LLM-based forecasting systems in high-stakes domains.
SN - 2045-2322
ER -