A multimodal context-aware AI recommender for smart farming
- 1Department of Computer Science and Applications, Kurukshetra University, Kurukshetra, Haryana, India
- 2Department of Research and Innovation, Mtech Mavens Company Limited, Dar es Salaam, Tanzania
Abstract
Agricultural productivity in developing regions is significantly affected by plant diseases and pest infestations, making early detection and timely intervention essential for improving crop yield and food security. This study proposes a multimodal context-aware AI recommendation framework that integrates maize leaf image analysis and environmental conditions to support intelligent agricultural decision-making. The framework combines a deep learning-based image classification model with weather variables, including temperature, humidity, rainfall, and solar radiation, through a multimodal fusion model for maize disease diagnosis. Based on the predicted crop condition, a context-aware recommendation engine integrates rule-based agronomic knowledge with the Qwen2.5:7B large language model to generate reliable and actionable natural-language recommendations for farmers. The generated recommendations are subsequently evaluated using Llama 3.1:8B in a blind LLM-based evaluation framework. Experiments were conducted using maize leaf images from the YEESI Lab dataset and a 61-day environmental dataset from the NASA POWER database, obtained for the geographic coordinates of Morogoro, Tanzania. Three maize conditions were considered: healthy plants, aphid infestation, and maize streak virus infection. The image-based model achieved an accuracy of 91%, while the weather-based model showed lower performance due to overlapping environmental characteristics among disease classes. The proposed multimodal fusion model achieved a classification accuracy of 94%, demonstrating the effectiveness of integrating visual and environmental information for disease diagnosis. The recommendation engine achieved an overall evaluation score of 4.80/5.00 across five quality dimensions—Safety, Technical Accuracy, Relevance, Actionability, and Clarity—indicating that the generated recommendations were agronomically consistent, context-aware, and actionable. The proposed framework provides an end-to-end AI-driven decision-support solution that integrates multimodal disease diagnosis, and context-aware recommendation for precision agriculture.
Related
- ROLE OF NANO-BIOINOCULANTS IN SMART FARMING: BRIDGING NANOTECHNOLOGY, FOOD SECURITY, AND SUSTAINABLE AGRICULTURE
- An embedded deep learning–fuzzy logic framework for intelligent and automated irrigation in smart farming
- Artificial Intelligence and Digital Technologies for Smart Farming and Precision Agriculture
- Modeling the global potential of smart farming innovations
- miRAssist: a context-aware, evidence integration framework for interpretable miRNA-target prioritization
BibTeX
@article{mhagama2026multimodal,
title = {{A multimodal context-aware AI recommender for smart farming}},
author = {John Telesphory Mhagama and Kanwal Garg},
journal = {PLOS One},
year = {2026},
month = oct,
doi = {10.1371/journal.pone.0359596},
url = {https://doi.org/10.1371/journal.pone.0359596},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - A multimodal context-aware AI recommender for smart farming
AU - John Telesphory Mhagama
AU - Kanwal Garg
PY - 2026
DA - 2026/10/08
JO - PLOS One
DO - 10.1371/journal.pone.0359596
UR - https://doi.org/10.1371/journal.pone.0359596
AB - Agricultural productivity in developing regions is significantly affected by plant diseases and pest infestations, making early detection and timely intervention essential for improving crop yield and food security. This study proposes a multimodal context-aware AI recommendation framework that integrates maize leaf image analysis and environmental conditions to support intelligent agricultural decision-making. The framework combines a deep learning-based image classification model with weather variables, including temperature, humidity, rainfall, and solar radiation, through a multimodal fusion model for maize disease diagnosis. Based on the predicted crop condition, a context-aware recommendation engine integrates rule-based agronomic knowledge with the Qwen2.5:7B large language model to generate reliable and actionable natural-language recommendations for farmers. The generated recommendations are subsequently evaluated using Llama 3.1:8B in a blind LLM-based evaluation framework. Experiments were conducted using maize leaf images from the YEESI Lab dataset and a 61-day environmental dataset from the NASA POWER database, obtained for the geographic coordinates of Morogoro, Tanzania. Three maize conditions were considered: healthy plants, aphid infestation, and maize streak virus infection. The image-based model achieved an accuracy of 91%, while the weather-based model showed lower performance due to overlapping environmental characteristics among disease classes. The proposed multimodal fusion model achieved a classification accuracy of 94%, demonstrating the effectiveness of integrating visual and environmental information for disease diagnosis. The recommendation engine achieved an overall evaluation score of 4.80/5.00 across five quality dimensions—Safety, Technical Accuracy, Relevance, Actionability, and Clarity—indicating that the generated recommendations were agronomically consistent, context-aware, and actionable. The proposed framework provides an end-to-end AI-driven decision-support solution that integrates multimodal disease diagnosis, and context-aware recommendation for precision agriculture.
SN - 1932-6203
ER -