TY  - JOUR
T1  - e-ksper: A Convolutional Neural Network Based System for Seedless Raisin Quality Grading
TT  - e-ksper: Çekirdeksiz Kuru Üzüm Kalite Değerlendirmesi için Evrişimsel Sinir Ağları Temelli Sistem
AU  - Gülsoylu, Emre
AU  - Çipiloğlu Yıldız, Zeynep
PY  - 2024
DA  - January
Y2  - 2023
JF  - Gazi Journal of Engineering Sciences
JO  - GJES
PB  - Parantez Teknoloji
WT  - DergiPark
SN  - 2149-9373
SP  - 453
EP  - 466
VL  - 9
IS  - 3
LA  - en
AB  - Seedless raisins are graded according to their quality which is determined based on several features such as color, size, texture, and humidity. Currently, most of the raisin grading process is performed by human experts manually, which is laborious and subjective work. Therefore, an automated system that enables objective evaluation of the raisins would be helpful for both producers and experts during this process. In this study, we propose a simple machinery prototype that takes images of raisins under standard background and illumination conditions and an automated system that performs quality grading of raisins using convolutional neural networks. The proposed model not only targets color classes but also aims to identify foreign matters and defected kernels. The model achieves about 88.2% average classification accuracy on five classes including four color classes and a defected kernels class; whereas the model's accuracy becomes 98.6% if defected kernels are excluded. Hence, the proposed model is very successful in differentiating colour classes and has also considerable success in detecting foreign matters and defected raisins. We provide a comprehensive analysis and discussion on these results.
KW  - raisin grading
KW  - raisin classification
KW  - convolutional neural networks
KW  - foreign matter detection
N2  - Çekirdeksiz kuru üzümler, renk, boyut, doku ve nem gibi çeşitli özelliklere göre belirlenen kalitelerine göre değerlendirilir. Mevcut şartlarda kuru üzüm sınıflandırma işleminin çoğu insan uzmanlar tarafından manuel olarak gerçekleştirilmektedir. Bu işlemin manuel olarak yapılması insan gücü açısından zahmetli olmakla birlikte öznel sonuçlar ortaya çıkarmaktadır. Bu nedenle, kuru üzümlerin objektif bir şekilde değerlendirilmesini sağlayan otomatik bir sistem, bu süreçte hem kuru üzüm üreticilerine hem de uzmanlara yardımcı olacaktır. Bu çalışmada, standart arka plan ve aydınlatma koşulları altında kuru üzümlerin görüntülerini alan basit bir makine prototipi ve evrişimsel sinir ağları kullanarak kuru üzümlerin kalite derecelendirmesini yapan otomatik bir sistem öneriyoruz. Önerilen model sadece renk sınıflarını değil, aynı zamanda yabancı maddeleri ve kusurlu çekirdekleri de tespit etmeyi amaçlamaktadır. Model, dört renk sınıfı ve bir kusurlu çekirdek sınıfı dahil olmak üzere beş sınıf üzerinde ortalama %88,2 sınıflandırma doğruluğu elde ederken, kusurlu çekirdekler hariç tutulduğunda modelin doğruluğu %98,6 olmaktadır. Dolayısıyla, önerilen model renk sınıflarını ayırt etmede çok başarılıdır ve ayrıca yabancı maddeleri ve kusurlu kuru üzümleri tespit etmede de önemli bir başarıya sahiptir. Bu çalışmada elde edilen sonuçlar üzerine kapsamlı bir analiz ve tartışma sunuyoruz.
CR  - [1] H. Ü. Evcim. A. Yazgı, E. Gülsoylu, E. Aykas, B. Çakmak, V. Demir, H. Yürdem, H. Güler, E. Urkan, F. Alayunt, H. Yalçın, H. Bilgen ve T. Günhan, "Tarimsal Mekanizasyonda Mevcut Durum ve Gelecek," Türkiye Ziraat Mühendisliği IX. Teknik Kongresi, 2020, ss. 497-526.
CR  - [2] S. S. Sajid and G. Hu, “Optimizing Crop Planting Schedule Considering Planting Window and Storage Capacity,” Frontiers in Plant Science, vol. 13, pp. 762446, 2022. doi: 10.3389/fpls.2022.762446
CR  - [3] E. A. Abioye, O. Hensel, T. J. Esau, O. Elijah, M. S. Z. Abidin, A. S. Ayobami, O. Yerima and A. Nasirahmadi, “Precision irrigation management using machine learning and digital farming solutions,” AgriEngineering, vol. 4, no. 1, pp. 70-103, 2022. doi: 10.3390/agriengineering4010006
CR  - [4] J. G. A. Barbedo, “Detecting and classifying pests in crops using proximal images and machine learning: A review,” AI, vol. 1, no. 2, pp. 312-328, 2020. doi: 10.3390/ai1020021
CR  - [5] E. J. Van Henten, J. Hemming, B. A. J. Van Tuijl, J. G. Kornet, J. Meuleman, J. Bontsema and E. A. Van Os,. “An autonomous robot for harvesting cucumbers in greenhouses,” Autonomous robots, vol. 13, no. 2, 241-258, 2002. doi: 10.1023/A:1020568125418
CR  - [6] X. Zhang, J. Yang, T. Lin, Y. Ying, “Food and agro-product quality evaluation based on spectroscopy and deep learning: A review,” Trends in Food Science & Technology, vol. 112, pp. 431-441, 2021. doi: 10.1016/j.tifs.2021.04.008
CR  - [7] S. Jagtap, F. Bader, G. Garcia-Garcia, H. Trollman, T. Fadiji, K. Salonitis, Food logistics 4.0: Opportunities and challenges. Logistics, vol. 5, no. 1, 2020. doi: 10.3390/logistics5010002
CR  - [8] T. Halstead, "Raisins: World Markets and Trade," Foreign Agricultural Service U.S. Department of Agriculture,  2018. Available: https://www.fas.usda.gov/data/raisins-world-markets-and-trade. [Accessed: 20.01.2023].
CR  - [9] A. Kayabasi, A. Toktas, K. Sabanci and E. Yigit, “Automatic classification of agricultural grains: Comparison of neural networks,” Neural Network World, vol. 28, no. 3, pp. 213–224, 2018. doi: 10.14311/nnw.2018.28.013
CR  - [10] K. Sabanci, A. Toktas and A. Kayabasi, “Grain classifier with computer vision using adaptive neuro-fuzzy inference system,” Journal of the Sicence of Food an Agriculture, vol. 97, no. 12, pp. 3994–4000, September 2017. doi: 10.1002/jsfa.8264
CR  - [11] P. P. Prasobhkumar, C.R. Francis and S.S. Gorthi, “Automated quality assessment of cocoons using a smart camera based system,” Engineering in Agriculture, Environment and Food, vol. 11, no. 4, pp. 202-210, 2018. doi: 10.1016/j.eaef.2018.05.002
CR  - [12] K. Rai, M. Dutta and S. Aggarwal, “A Grading System For Fruits Maturity Using Neural Networks Approach,” International Journal of Advanced Research in Computer Science, vol. 2, no. 6, pp. 451-454, 2011. doi: 10.26483/ijarcs.v2i6.868
CR  - [13] J. A. Kodagali and S. Balaji, “Computer vision and image analysis based techniques for automatic characterization of fruits-a review,” International Journal of Computer Applications, vol. 50, no. 6, pp. 451-454, 2012. doi: 10.5120/7773-0856
CR  - [14] M. P. Raj and P. Swaminarayan, “Applications of image processing for grading agriculture products,” International Journal on Recent and Innovation Trends in Computing and Communication, vol. 3, no. 3, pp. 1194-1201, March 2015. doi: 10.17762/ijritcc.v3i3.4000
CR  - [15] D. Saha and A. Manickavasagan, “Machine learning techniques for analysis of hyperspectral images to determine quality of food products: A review,” Current Research in Food Science, vol. 4, pp. 28-44, 2021. doi: 10.1016/j.crfs.2021.01.002
CR  - [16] H. Chopra, H. Singh, M. S. Bamrah, F. Mahbubani, A. Verma, N. Hooda, P. S. Rana, R. K. Singla and A. K. Singh, “Efficient fruit grading system using spectrophotometry and machine learning approaches,” IEEE Sensors Journal, vol. 21, no. 14, pp. 16162-16169, 2021. doi: 10.1109/JSEN.2021.3075465
CR  - [17] I. Cınar, M. Koklu and S. Tasdemir, “Classification of Raisin Grains Using Machine Vision and Artificial Intelligence Methods,” Gazi Journal of Engineering Sciences, vol. 6, no. 3, pp. 200-209, December, 2020, doi: 10.30855/gmbd.2020.03.03
CR  - [18] S. Kılıçarslan, "Kurum Üzüm Tanelerinin Sınıflandırılması İçin Hibrit Bir Yaklaşım", Mühendislik Bilimleri ve Araştırmaları Dergisi, cilt 4, sayı 1, ss. 62-71, 2022, doi:10.46387/bjesr.1084590
CR  - [19] I. Terzi, " Derin Öğrenme Teknikleri ile Üzüm Çeşitlerinin Belirlenmesi," Doktora Tezi, Biyosistem Mühenisliği, Tokat Gaziosmanpaşa Üniversitesi, Tokat, 2023.
CR  - [20] J. Guo, C. Chen, C. Chen, E. Zuo, B. Dong, X. Lv and W. Yang, “Near-infrared spectroscopy combined with pattern recognition algorithms to quickly classify raisins,” Scientific Reports, vol. 12, no. 1, pp. 7928, 2022. doi: 10.1038/s41598-022-12001-1
CR  - [21] M. Omid, M. Abbasgolipour, A. Keyhani and S. S. Mohtasebi, “Implementation of an efficient image processing algorithm for grading raisins,” International Journal of Signal and Image Processing, vol. 1, no. 1, pp. 31-34, 2010.
CR  - [22] S. Wang, K. Liu, X. Yu, D. Wu and Y. He, “Application of hybrid image features for fast and non-invasive classification of raisin,” Journal of Food Engineering, vol. 109, no. 3, pp. 531-537, 2012. doi: 10.1016/j.jfoodeng.2011.10.028
CR  - [23] X. Yu, K. Liu, D. Wu and Y. He, “Raisin quality classification using least squares support vector machine (LSSVM) based on combined color and texture features,” Food and Bioprocess Technology, vol. 5, no. 5, pp. 1552-1563, 2012. doi: 10.1007/s11947-011-0531-9
CR  - [24] S. P. Pawar and A. Sarkar, “Cost Effective Grading Process for Grape Raisins based on HSI and Fuzzy Logic Algorithms,” International Journal of Computer Applications, vol. 67, no. 22, pp. 18-22, April 2013.
CR  - [25] X. Li and X. Liu, “Detection Level of Raisins Based on Neural Network and Digital Image,” 2011 Third Pacific-Asia Conference on Circuits, Communications and System, pp. 1-3, 2011. doi: 10.1109/PACCS.2011.5990209
CR  - [26] S. A. Angadi and N. Hiregoudar, “A Cost Effective Algorithm for Grading Raisins Using Image Processing,” International Journal of Recent Trends in Engineering & Research (IJRTER), vol. 2, pp. 2455-1457, 2016.
CR  - [27] K. Mollazade, M. Omid and A. Arefi, “Comparing data mining classifiers for grading raisins based on visual features,” Computers and Electronics in Agriculture, vol. 84, pp. 124-131, June 2012. doi: 10.1016/j.compag.2012.03.004
CR  - [28] N. Karimi, R. R. Kondrood and T. Alizadeh, “An intelligent system for quality measurement of Golden Bleached raisins using two comparative machine learning algorithms,” Measurement, vol. 107, pp. 68-76, September 2017. doi: 10.1016/j.measurement.2017.05.009
CR  - [29] M. Khojastehnazhand and H. Ramezani, “Machine vision system for classification of bulk raisins using texture features,” Journal of Food Engineering, vol. 271, no. 3, pp. 109864, April 2020. doi: 10.1016/j.jfoodeng.2019.109864
CR  - [30] Y. Zhao, X. Xu and Y. He, “A Novel Hyperspectral Feature-Extraction Algorithm Based on Waveform Resolution for Raisin Classification,” Applied Spectroscopy, vol. 69, no. 12, pp. 1194-1201, 2015.
CR  - [31] K. G. Shinde and B. G. Patil, “Sorting of raisins using computer vision approach,” International Research Journal of Engineering and Technology, vol. 4, no. 6, pp. 2540-2544, June 2017.
CR  - [32] M. Abbasgholipour, M. Omid and A. Keyhani, “Color image segmentation with genetic algorithm in a raisin sorting system based on machine vision in variable conditions,” Expert Systems with Applications, vol. 38, no. 4, pp. 3671-3678, April 2011. doi: 10.1016/j.eswa.2010.09.023
CR  - [33] TSE Ziraat İhtisas Grubu, “Seedless raisin (TS 3411),” Turkish Standards Institution, vol. TR3411, 2011.
CR  - [34] N. Otsu, “A threshold selection method from gray-level histograms,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 9, no. 1, pp. 62-66, January 1979.
CR  - [35] Y. LeCun, Y. Bengio and G. E. Hinton, “Deep learning,” Nature, vol. 521, pp. 436-444, May 2015. doi: 10.1038/nature14539
CR  - [36] A. Krizhevsky, I. Sutskever and G. E. Hinton, “ImageNet classification with deep convolutional neural networks,” Communications of the ACM, vol. 60, no. 6, pp. 84-90, June 2017. doi: 10.1145/3065386
CR  - [37] C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke and A. Rabinovich, “Going Deeper With Convolutions,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, June 7-12, 2015, pp. 1-9.
CR  - [38] C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A. Rabinovich, “Imagenet: A large-scale hierarchical image database,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA, June 20-25, 2009, pp. 248-255.
UR  - https://dergipark.org.tr/en/pub/gmbd/article/1240092
L1  - https://dergipark.org.tr/en/download/article-file/2907865
ER  -