A Smart Multimodal System for Crop Disease Detection and Agricultural Decision Support

Precision agriculture has become an important research area for improving crop productivity, food security, and sustainable farming practices. Crop diseases significantly reduce agricultural yield and economic stability, especially in developing agricultural economies. Traditional disease detection methods rely heavily on manual inspection and expert knowledge, which are time-consuming and often inaccurate under large-scale farming conditions. This manuscript proposes a multimodal artificial intelligence framework that integrates Convolutional Neural Networks (CNNs), Vision Transformers (ViTs), environmental parameters, and reasoning-based support systems for crop disease identification and agricultural decision support.

The proposed system combines crop leaf images, weather conditions, and environmental sensor data to improve disease classification performance. The PlantVillage dataset containing approximately 54,000 crop leaf images across multiple disease categories was utilized for experimentation. Image preprocessing techniques such as resizing, normalization, augmentation, and noise removal were applied before model training. A hybrid CNN-Transformer architecture was implemented using Adam optimizer with a learning rate of 0.001 over 50 epochs. Experimental evaluation demonstrated an overall classification accuracy of 93.2%, outperforming traditional CNN-only approaches.
The system also provides treatment recommendations and environmental analysis to support farmers in real-time decision-making. Comparative evaluation using precision, recall, F1-score, and confusion matrix analysis confirms the effectiveness of multimodal data fusion. Although computational complexity and deployment challenges remain limitations, the proposed framework demonstrates strong potential for smart agriculture applications.

Precision Agriculture, Crop Disease Detection, Multimodal Artificial Intelligence, Convolutional Neural Networks (CNNs), Vision Transformers (ViTs)

1. P. Sharma et al., “CNN-Based Plant Disease Detection Using Deep Learning,” Computers and Electronics in Agriculture, vol. 198, pp. 106912, 2022. [Google Scholar] [Crossref]

2. H. Thai et al., “Vision Transformer Models for Agricultural Image Classification,” IEEE Access, vol. 11, pp. 102345–102358, 2023. [Google Scholar] [Crossref]

3. Y. Lu et al., “Multimodal Artificial Intelligence for Smart Agriculture,” Artificial Intelligence in Agriculture, vol. 8, pp. 45–58, 2024. [Google Scholar] [Crossref]

4. C. Xu et al., “Hybrid Deep Learning Models for Crop Disease Identification,” Expert Systems with Applications, vol. 245, pp. 122541, 2025. [Google Scholar] [Crossref]

5. Q. Li et al., “AgroMind: Multimodal Models in Precision Agriculture,” Computers and Electronics in Agriculture, vol. 224, pp. 108115, 2025. [Google Scholar] [Crossref]

6. D. Das et al., “Machine Learning Approaches in Precision Farming,” Sustainable Computing, vol. 29, pp. 100450, 2021. [Google Scholar] [Crossref]

7. P. Bedi et al., “Hybrid CNN-Transformer Architectures for Plant Disease Detection,” Neural Computing and Applications, vol. 32, no. 18, pp. 14567–14581, 2020. [Google Scholar] [Crossref]

8. S. Mohanty et al., “Using Deep Learning for Image-Based Plant Disease Detection,” Frontiers in Plant Science, vol. 7, pp. 1419, 2016. [Google Scholar] [Crossref]

9. A. Ferentinos, “Deep Learning Models for Plant Disease Detection and Diagnosis,” Computers and Electronics in Agriculture, vol. 145, pp. 311–318, 2018. [Google Scholar] [Crossref]

10. J. Too et al., “A Comparative Study of Fine-Tuning Deep Learning Models for Plant Disease Identification,” Computers and Electronics in Agriculture, vol. 161, pp. 272–279, 2019. [Google Scholar] [Crossref]

• The Role of Artificial Intelligence in Revolutionizing Library Services in Nairobi: Ethical Implications and Future Trends in User Interaction
• ESPYREAL: A Mobile Based Multi-Currency Identifier for Visually Impaired Individuals Using Convolutional Neural Network
• Comparative Analysis of AI-Driven IoT-Based Smart Agriculture Platforms with Blockchain-Enabled Marketplaces
• AI-Based Dish Recommender System for Reducing Fruit Waste through Spoilage Detection and Ripeness Assessment
• SEA-TALK: An AI-Powered Voice Translator and Southeast Asian Dialects Recognition