Image Processing and Traditional Machine Learning Based Classification of Brown Marmorated Stink Bug (Halyomorpha Halys) Defected Hazelnut

Year 2023, Volume: 20 Issue: 4, 784 - 798, 25.12.2023

Omsalma Alsadig Adam Gadalla , Y. Benal Öztekin

https://doi.org/10.33462/jotaf.1165105

Cited By: 1

Abstract

Quality control of hazelnuts is a major concern in many regions across the world, but particularly in Turkey as the world's largest hazelnut producer. Using image processing and deep learning techniques, this study intended to detect and classify healthy hazelnuts and hazelnuts infected with the Brown Marmorated Stink Bug. Infected hazelnut samples were collected from the 2021 production period by experts. A Guppy Pro CCD camera-based image acquisition system was used to capture hazelnut images. A total of 400 RGB hazelnut images were captured to train machine learning models. Image segmentation process was carried out to subtract hazelnut images from the background using the Thresholding technique. Moment features were extracted from RGB and l*a*b* spaces to be used to train traditional machine learning models. Furthermore, the most relevant and discriminative feature set was selected using the Boruta feature selection method. Traditional machine learning models including Random Forest, Support Vector Machine, Logistic Regression, Naive Bayes, and Decision Tree were trained twice, once with all features and another with the selected feature set only. The overall accuracy, statistical characteristics of the confusion matrix, and model training time were all calculated to evaluate and compare models performances. As a result, threshold value of 50 was determined from the gray level histogram and was able to separate hazelnut image from the background perfectly. Only seven moment features were identified as the most discriminative features out of 24 features. The SVM model with all feature vectors had the greatest classification accuracy of 98.75 %. When only the selected features were employed, the performance of Random Forest and Logistic Regression models improved to 97.5 and 96.25 %, respectively.

Keywords

Support Vector Machine, Hazelnut, Feature selection, Feature extraction, Boruta

Supporting Institution

Ondokuz Mayis University

Project Number

Project number: PYO. ZRT.1904.21.001.

Görüntü İşleme ve Geleneksel Makina Öğrenmeye Dayalı Fındıkta Kahverengi Kokarca (Halyomorpha Halys) Zararının Sınıflandırılması

Abstract

Fındığın kalite kontrolü, dünyanın birçok bölgesinde, özellikle de dünyanın en büyük fındık üreticisi olan Türkiye'de büyük bir problem kaynağıdır. Bu çalışma, görüntü işleme ve derin öğrenme tekniklerini kullanarak, Kahverengi Kokarca ile enfekte olmuş ve sağlıklı fındıkları birbirinden ayırarak belirlemek ve sınıflandırmak amaçlanmıştır. Kahverengi Kokarcalı fındık örnekleri, uzmanlar tarafından 2021 üretim döneminden elde edilmiştir. Fındık görüntülerini yakalamak için Guppy Pro CCD kamera tabanlı görüntü alma sistemi kullanılmıştır. Geleneksel makine öğrenme modellerini eğitmek için toplam olarak 400 RGB fındık görüntüsü alınmıştır. Fındık görüntülerinin arka plandan çıkarılması için görüntü bölüntüleme işlemi Eşikleme tekniği kullanılarak gerçekleştirilmiştir. Fındık moment özellikleri, geleneksel makine öğrenme modellerini eğitmek için kullanılmak üzere RGB ve l*a*b* renk çıkarılmıştır. Ayrıca, Boruta özellik seçim yöntemi kullanılarak en önemli ve en ayırt edici öznitelik seti seçilmiştir. Rastgele Orman, Destek Vektör Makinesi, Lojistik Regresyon, Naive Bayes ve Karar Ağacı dâhil olmak üzere geleneksel makine öğrenme modelleri, bir kez tüm özelliklerle ve bir kez daha yalnızca seçilmiş özelliklerle olmak üzere iki kez eğitilmiştir. Genel doğruluk, karışıklık matrisinin istatistiksel özellikleri ve model eğitim süresinin tümü, modelin sınıflandırma performansını değerlendirmek ve karşılaştırmak için hesaplanmıştır. Sonuç olarak, gri seviye histogramından 50 eşik değeri belirlenmiştir ve fındık görüntüsünü arka plandan mükemmel bir şekilde ayırabilmiştir. Çıkartılmış 24 özellik arasından en ayırt edici özellik olarak sadece yedi tane renk özelliği belirlenmiştir. Tüm çıkartılmış özellikler kullandıktan sonra Destek Vektör Makinesi modeli kullanılarak, %98.75 ile en yüksek sınıflandırma doğruluğu elde edilmiştir. Aynı zamanda tüm özelliklerden sadece seçilen özellikler kullanıldığında Rastgele Orman ve Lojistik Regresyon (sınılandırıcılarının) modellerinin performansı sırasıyla %97.5 ve %96.25'e kadar yükselmiştir.

Keywords

Boruta, Destek Vektör Makinesi, Fındık, Özellik seçme, Özellik çıkartma

Project Number

Project number: PYO. ZRT.1904.21.001.

References

• Akshay, S. and Hegde, A. (2021). Detection and classification of areca nut diseases. 2021 Second International Conference on Electronics and Sustainable Communication Systems (ICESC). 1-3 September, P.1-5. Kottayam, India.
• Ali, I. (2018). Hazelnut cultivation in Turkey. Academic Journal of Agriculture, 6(1): 1-13.
• Anonymous. (2019). Fındıkta ‘kahverengi- yeşil kokarca’ tehdidi. https://www.sozcu.com.tr/2019/ekonomi/findikta-kahverengi-yesil-kokarca-tehdidi-4007632/(Accessed date: December 2021).
• Aydinoglu, A. C. (2010). Examining environmental condition on the growth areas of Turkish hazelnut (Corylus colurna L.). African Journal of Biotechnology, 9(39): 6492-6502.
• Baitu, G. P., Gadalla O. A. A. and Oztekin, Y. B. (2023). Traditional machine learning-based classification of cashew kernels using colour features. Journal of Tekirdağ Agricultural Faculty, 20(1): 115-124.
• Balachandran, P. V., Xue, D., Theiler, J., Hogden, J., Gubernatis, J. E. and Lookman, T. (2018). Importance of feature selection in machine learning and adaptive design for materials. Materials Discovery and Design, 4(4): 100-107.
• Christopher. (2014). The effects of kernel feeding by brown marmorated stink bug (Halyomorpha halys:Hemiptera: Pentatomidae) on commercial hazelnuts (Corylus avellana L.). (Master of Science). Oregon State University.
• FAOSTAT. (2019). Crops Production Data. Retrieved fromm http://www. fao.org/faostat/en/data/QC. (Accessed date: 10 April 2021).
• Ghosh, S., Biswas, S., Sarkar, D. and Sarkar, P. P. (2014). A novel Neuro-fuzzy classification technique for data mining. Egyptian Informatics Journal, 15(3): 129-147.
• Guvenc, S. A., Senel, F. A. and Cetisli, B. (2015). Classification of processed hazelnuts with computer vision. 23rd Signal Processing and Communications Applications Conference (SIU)., 29-1 November, Germany.
• Hong, C., Jing, W., Qiaoxia, Y. and Peng, W. (2011). Quality classification of peanuts based on image processing, Huazhong Agricultural University Journal, 24(5): 115-121.
• Kalkan, H. and Çetisli, B. (2011). Online feature selection and classification. InAcoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference . May 22 (pp. 2124-2127), Ankara, Turkey.
• Kivrak, O. and Gürbüz, M. (2019). Detection of defective hazelnuts by image processing and machine learning. Natural and Engineering Sciences, 4(3): 100-106.
• Memoli, A., Albanese, D., Esti, M., Lombardelli, C., Crescitelli, A., Di Matteo, M. and Benucci, I. (2017). Effect of bug damage and mold contamination on fatty acids and sterols of hazelnut oil. European Food Research and Technology, 243(4): 166-181.
• Mitchell, P. L. (2018). Heteroptera as vectors of plant pathogens. Neotropical Entomology, 33:519–545. Molnar, T. (2010). The Brown Marmorated Stink Bug: A new Pest of Hazelnut. Journal of Food Technology, 9(1): 33-38.
• Narendra, V. G. and Hareesh, K. S. (2016). Prospects of computer vision automated grading and sorting systems in agricultural and food products for quality evaluation. International Journal of Computer Applications, 4(9): 75–87.
• Nouri, A, H., Omid, M., Mohtasebi, S. S. and Firouz, M. S. (2017). Design, development and evaluation of an online grading system for peeled pistachios equipped with machine vision technology and support vector machine. Information Processing in Agriculture, 4(4): 333-341.
• Onaran, I., Dulek, B., Pearson, T. C., Yardimci, Y. and Cetin, A. E. (2005). Detection of empty hazelnuts from fully developed nuts by impact acoustics. 2005International Signal Processing Conference, Sep 4 (pp. 1-4).
• Özlüoymak, Ö, B. and Guzel, E. (2020). Determination of Colour and Kinetic Parameter Differences Between Aflatoxin Contaminated and Uncontaminated Pistachio Nuts Using Machine Vision. Journal of Tekirdag Agricultural Faculty, 18(1): 157-168.
• Pacheco, W. D. N. and López, F. R. J. (2019). Tomato classification according to organoleptic maturity (coloration) using machine learning algorithms K-NN, MLP, and K-Means Clustering. 2019 XXII Symposium on Image, Signal Processing and Artificial Vision (STSIVA), Dec30, (pp. 1-5) Bucaramanga, Colombia.
• Raybaut, P. (2009). (Python) (ANN) Spyder v1.0.0 released". [Press release] Saruhan, I. (2010). Brown Marmorated Stink Bug in Hazelnut (Palomena Prasina L. Heteroptera: Pe Tatomidae), Anatolian Journal of Agricultural Sciences, 25('2): 75-83.
• Senthilkumaran, N. and Vaithegi, S. (2016). Image segmentation by using thresholding techniques for medical images. Computer Science & Engineering: An International Journal, 6(1): 1-13.
• Short., B. A. (2010). Factors affecting appearance of stink bug (Hemiptera: Pentatomidae) injury on apple. Environmental Entomology, 39: 134-139.
• Solak, S. and Altinisik, U. (2018). Detection and classification of hazelnut fruit by using image processing techniques and clustering methods. Sakarya University Journal of Science, 22(1): 56-65.
• Taheri, G, A., Ahmadi, H., Omid, M., Mohtasebi, S. S., Mollazade, K., Smith, A. J. R. and Carlomagno, G. M. (2015). An intelligent approach for cooling radiator fault diagnosis based on infrared thermal image processing technique. Applied Thermal Engineering Jpurnal, 87(4): 434-443.
• Teimouri, N., Omid, M., Mollazade, K. and Rajabipour, A. (2016). An artificial neural network‐based method to identify five classes of almond according to visual features. Journal of Food Process Engineering, 39(6): 625-635.
• Yadhunath, R., Srikanth, S., Sudheer, A., Jyotsna, C. and Amudha, J. (2022). Detecting surface cracks on buildings using computer vision: an experimental comparison of digital image processing and deep learning. (197-210). In: Reddy, V. S., Prasad, V. K., Wang, J., Reddy, K. T. V. (eds) Soft Computing and Signal Processing. Advances in Intelligent Systems and Computing, vol 1340. Springer, Singapore.