Deep Feature Extraction for Detection of Tomato Plant Diseases and Pests based on Leaf Images

Abstract

Plant diseases and pests cause yield and quality losses. It has great importance to detect plant diseases and pests quickly and with high accuracy in terms of preventing yield and quality losses. Plant disease and pest detection performed by plant protection experts through visual observation is a labor-intensive process with a high error rate. Developing effective, fast and highly successful computer-aided disease detection systems has become a necessity in terms of precision agriculture applications. In this study, well-known pre-trained convolutional neural network (CNN) models AlexNet, GoogLeNet and ResNet-50 are used as feature extractors. In addition, a deep learning model that concatenate deep features extracted from 3 CNN models has been proposed. The deep features were used to train the support vector machine classifier. The proposed model was used to classify leaf images of tomato plant diseases and pests, which is a subset of open-access PlantVillage dataset consisting of a total of 18835 images belonging to 10 classes including a healthy one. Accuracy, precision, sensitivity and f-score performance metrics were used with the hold-out validation method in determining model performances. Experimental results show that the detection of tomato plant diseases and pests is possible using concatenated deep features with an overall accuracy rate of 96.99%.

Keywords

• convolutional neural networks
• deep features extraction
• deep learning
• image classification
• plant diseases and pests detection
• precision agriculture

References

1. Mohanty, SP, Hughes, DP, Salathé, M. 2016. Using deep learning for image-based plant disease detection. Frontiers in plant science; 7: 1419.
2. Ferentinos, KP. 2018. Deep learning models for plant disease detection and diagnosis. Computers and Electronics in Agriculture; 145: 311-318.
3. Al-Hiary, H, Bani-Ahmad, S, Reyalat, M, Braik, M, Alrahamneh, Z. 2011. Fast and accurate detection and classification of plant diseases. International Journal of Computer Applications; 17(1): 31-38.
4. Dubey, SR, Jalal, AS. Detection and classification of apple fruit diseases using complete local binary patterns, proceedings of the 3rd international conference on computer and communication technology, Allahabad, India, 2012, pp 346-351.
5. Singh, V, Misra, AK. 2017. Detection of plant leaf diseases using image segmentation and soft computing techniques. Information processing in Agriculture; 4(1): 41-49.
6. LeCun, Y, Bengio, Y, Hinton, G. 2015. Deep learning. Nature; 521(7553): 436-444.
7. Ünal, Z. 2020. Smart Farming Becomes Even Smarter With Deep Learning - A Bibliographical Analysis. IEEE Access; 8:105587-105609.
8. [Kamilaris, A, Prenafeta-Boldú, FX. 2018. Deep learning in agriculture: A survey. Computers and Electronics in Agriculture; 147: 70-90.

9. Zhong, Y, Zhao, M. 2020. Research on deep learning in apple leaf disease recognition. Computers and Electronics in Agriculture; 168: 105146.
10. Fujita, E, Kawasaki, Y, Uga, H, Kagiwada, S, Iyatomi, H. Basic investigation on a robust and practical plant diagnostic system, proceedings of the 15th IEEE International Conference on Machine Learning and Applications, Anaheim CA, USA, 2016, pp 989-992.
11. Lu, Y, Yi, S, Zeng, N, Liu, Y, Zhang, Y. 2017. Identification of rice diseases using deep convolutional neural networks. Neurocomputing; 267: 378-384.
12. Fuentes, A, Yoon, S, Kim, SC, Park, DS. 2017. A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors; 17(9): 2022.
13. Durmuş, H, Güneş, EO, Kırcı, M. Disease detection on the leaves of the tomato plants by using deep learning, proceedings of the 6th International Conference on Agro-Geoinformatics, Fairfax VA, USA, 2017, pp 1-5.
14. Sardogan, M, Tuncer, A, Ozen, Y. Plant leaf disease detection and classification based on CNN with LVQ algorithm, proceedings of the 3rd International Conference on Computer Science and Engineering, Sarajevo, Bosnia and Herzegovina, 2018, pp 382-385.
15. Rangarajan, AK, Purushothaman, R, Ramesh, A. 2018. Tomato crop disease classification using pre-trained deep learning algorithm. Procedia computer science; 133: 1040-1047.
16. Aversano, L, Bernardi, ML, Cimitile, M, Iammarino, M, Rondinella, S. Tomato diseases Classification Based on VGG and Transfer Learning, proceedings of the IEEE International Workshop on Metrology for Agriculture and Forestry, Virtual Conference, 2020, pp 129-133.
17. Agarwal, M, Singh, A, Arjaria, S, Sinha, A, Gupta, S. 2020. ToLeD: Tomato leaf disease detection using convolution neural network. Procedia Computer Science; 167: 293-301.
18. Saeed, F, Khan, MA, Sharif, M, Mittal, M, Goyal, LM, Roy, S. 2021. Deep neural network features fusion and selection based on PLS regression with an application for crops diseases classification. Applied Soft Computing; 103: 107164.
19. Hughes, D, Salathé, M. 2015. An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv preprint; arXiv:1511.08060.
20. Geetharamani, G, Pandian, A. 2019. Identification of plant leaf diseases using a nine-layer deep convolutional neural network. Computers & Electrical Engineering; 76: 323-338.
21. Altuntaş, Y, Cömert, Z, Kocamaz, AF. 2019. Identification of haploid and diploid maize seeds using convolutional neural networks and a transfer learning approach. Computers and Electronics in Agriculture; 163: 104874.
22. Chatfield, K, Simonyan, K, Vedaldi, A, Zisserman, A. 2014. Return of the devil in the details: Delving deep into convolutional nets. arXiv preprint; arXiv:1405.3531.
23. Toğaçar, M, Ergen, B, Cömert, Z. 2020. Classification of flower species by using features extracted from the intersection of feature selection methods in convolutional neural network models. Measurement; 158: 107703.
24. Krizhevsky, A, Sutskever, I, Hinton, GE. 2012. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems; 25: 1097-1105.
25. Szegedy, C, Liu, W, Jia, Y, Sermanet, P, Reed, S, Anguelov, D, Rabinovich, A. Going deeper with convolutions, proceedings of the IEEE conference on computer vision and pattern recognition, Boston MA, USA, 2015, pp 1-9.
26. He, K, Zhang, X, Ren, S, Sun, J. Deep residual learning for image recognition, proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas NV, USA, 2016, pp 770-778.
27. Vapnik, VN. The nature of statistical learning theory; Springer, New York, USA, 2000; pp 313.
28. Altuntaş, Y, Kocamaz, AF. 2019. Renk momentleri ve destek vektör makineleri kullanarak haploid mısır tohumlarının tanımlanmasında renk uzaylarının sınıflandırma performansına etkisinin karşılaştırılması. Fırat Üniversitesi Mühendislik Bilimleri Dergisi; 31(2): 551-560.
29. Huang, S, Cai, N, Pacheco, PP, Narrandes, S, Wang, Y, Xu, W. 2018. Applications of support vector machine (SVM) learning in cancer genomics. Cancer Genomics-Proteomics; 15(1): 41-51.
30. Bishop, CM. Pattern recognition and machine learning; Springer, New York, USA, 2006; pp 738.