Research Article
BibTex RIS Cite

Comparative analysis of mature tomato detection by feature extraction and machine learning for autonomous greenhouse robots

Year 2023, Volume: 65 Issue: 2, 100 - 114, 29.12.2023
https://doi.org/10.33769/aupse.1274677

Abstract

Accurate detection of tomatoes grown in greenhouses is important for timely harvesting. In this way, it is ensured that mature tomatoes are collected by distinguishing them from the unripe ones. Insufficient light, occlusion, and overlapping adversely affect the detection of mature tomatoes. In addition, it is time consuming for people to detect mature tomatoes at certain periods in large greenhouses. For these reasons, high-performance automatic detection of tomatoes by greenhouse robots has become an increasingly studied area today. In this paper, two feature extraction methods, histogram of oriented gradients (HOG) and local binary patterns (LBP), which are effective in object recognition, and two important and commonly used classifiers of machine learning, support vector machines (SVM) and k-nearest neighbor (kNN), are comparatively used to detect and count tomatoes. The HOG and LBP features are classified separately and together by SVM or kNN, and the success of each case are compared. Performance of the detection is improved by eliminating false positive results at the postprocessing stage using color information.

Supporting Institution

The Scientific and Technological Research Council of Turkey (TÜBİTAK)

Project Number

7201372

References

  • Liu, G., Mao, S., Kim, J. H., A mature-tomato detection algorithm using machine learning and color analysis, Sensors 2019, 19 (2023), https://doi.org/10.3390/s19092023.
  • Onishi, Y., Yoshida, T., Kurita, H. et al., An automated fruit harvesting robot by using deep learning, Robomech J., 6 (13) (2019).
  • Selvaraj, A., Shebiah, N., Nidhyananthan, S., Ganesan, L., Fruit recognition using color and texture features, J. Emerg. Trends Comput. Inf. Sci., 1 (2010), 90-94.
  • Bulanon, D. M., Kataoka, T., Ota, Y., Hiroma, T., AE-Automation and emerging technologies: A segmentation algorithm for the automatic recognition of fuji apples at harvest, Biosyst. Eng., 83 (4) (2002), 405-412.
  • Liu, X., Zhao, D., Jia, W., Ji, W., & Sun, Y., A detection method for apple fruits based on color and shape features, IEEE Access, 7 (2019), 67923–67933.
  • Mao, W., Ji, B., Zhan, J., Zhang, X. and Hu, X., Apple location method for the apple harvesting robot, 2009 2nd International Congress on Image and Signal Processing, (2009),1-5.
  • Tanigaki, K., Fujiura, T., Akase, A., Imagawa, J., Cherry-harvesting robot, Comput. Electron. Agric., 63 (1) (2008), 65-72.
  • Ji, W., Zhao, D., Cheng, F., Xu, B., Zhang, Y., Wang, J., Automatic recognition vision system guided for apple harvesting robot, Comput. Elec. Eng., 38 (5) (2012), 1186-1195.
  • Kurtulmus, F., Lee, W.S., Vardar, A., Immature peach detection in colour images acquired in natural illumination conditions using statistical classifiers and neural network, Precision Agric., 15 (2014) 57–79.
  • Song, Y., Glasbey, C. A., Horgan, G. W., Polder, G., Dieleman, J. A., van der Heijden, G. W. A. M., Automatic fruit recognition and counting from multiple images, Biosyst. Eng., 118 (2014), 203-215, https://doi.org/10.1016/j.biosystemseng.2013.12.008.
  • Islam, M. A., Yousuf, Md. S. I., Billah, M. M., Automatic plant detection using HOG and LBP features with SVM, Int. J. Comput., 33 (1) (2019), 26-38.
  • Hummel, R. A., Image enhancement by histogram transformation, Comput. Graphics Image Process., 6 (1977), 184-195.
  • Ketcham, D. J., Lowe, R. W. and Weber, J. W., Real-time image enhancement techniques, Seminar on Image Processing, (1976), 1-6.
  • Pizer, S. M., Intensity mappings for the display of medical images, Functional Mapping of Organ Systems and Other Computer Topics, Society of Nuclear Medicine (1981).
  • Pizer, S. M., Amburn, E. P., Austin, J. D., et al., Adaptive histogram equalization and its variations, Computer Vision, Graphics, and Image Processing, 39 (1987), 355-368.
  • Maison, Lestari, T., Luthfi, A., Retinal blood vessel segmentation using gaussian filter, J. Phys.: Conf. Ser., 1376 (2019), 012023, https://doi.org/10.1088/1742-6596/1376/1/012023.
  • Umri, B. K., Utami, E. and Kurniawan, M. P., Comparative analysis of CLAHE and AHE on application of CNN algorithm in the detection of Covid-19 patients, 2021 4th Int. Conf. on Inf. and Comm. Tech. (ICOIACT), (2021), 203-208, https://doi.org/10.1109/ICOIACT53268.2021.9563980.
  • Wang, Q., Lu, Y., Zhang, X., Hahn, J., Region of interest selection for functional features, Neurocomputing, 422 (2021), 235-244.
  • Zhang, L., Sun, Q. and Zhang, J., Region of interest extraction via common salient feature analysis and feedback reinforcement strategy for remote sensing images, GI Science Remote Sens., 55 (5) (2018), 745-762.
  • Vogt, P., Riitters, K. H., Estreguil, C., Kozak, J., Wade, T. G., Wickham, J. D. , Mapping spatial patterns with morphological, Image Processing, 22 (2) (2007), 171-177.
  • [21] Dalal, N. and Triggs, B., Histograms of oriented gradients for human detection, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), (2005), 886-893.
  • Tuncer, T. and Avcı, E., Yerel ikili örüntü tabanlı veri gizleme algoritması: LBP-LSB, Türkiye Bilişim Vakfı Bilgisayar Bilimleri ve Mühendisliği Dergisi, 10 (1) (2017) 48-53.
  • Chen, J., Kellokumpu, V., Zhao, G., Pietikainen, M., RLBP: Robust Local Binary Pattern, Proceedings British Machine Vision Conference 2013, 122 (2014),1-11, http://dx.doi.org/10.5244/C.27.122.
  • Cortes, C. and Vapnik, V., Support-Vector Networks, Mach. Learn., 20 (1995), 273-297, http://dx.doi.org/10.1007/BF00994018.
  • [Kuang, Q. and Zhao, L., A practical GPU based KNN algorithm, Proceedings of the Second Symposium International Computer Science and Computational Technology (ISCSCT '09), (2009), 151-155.
  • Li, H., Chen, L., Removal of false positive in object detection with contour-based classifiers, 2010 IEEE International Conference on Image Processing, (2010), 3941-3944.
  • Rothe, R., Guillaumin, M., Van Gool, L., Non-maximum suppression for object detection by passing messages between windows, Computer Vision ACCV 2014, 9003 (2015), 290-306, https://doi.org/10.1007/978-3-319-16865-4_19.
  • Salscheider, N. O., FeatureNMS: Non-maximum suppression by learning feature embeddings, 25th International Conference on Pattern Recognition (ICPR), (2020), 7848-7854.
  • Liu, G., Mao, S., Open tomatoes dataset, (2019). Available at: https://github.com/pandalgx/Tomato-dataset. [Accessed February 2023].
Year 2023, Volume: 65 Issue: 2, 100 - 114, 29.12.2023
https://doi.org/10.33769/aupse.1274677

Abstract

Project Number

7201372

References

  • Liu, G., Mao, S., Kim, J. H., A mature-tomato detection algorithm using machine learning and color analysis, Sensors 2019, 19 (2023), https://doi.org/10.3390/s19092023.
  • Onishi, Y., Yoshida, T., Kurita, H. et al., An automated fruit harvesting robot by using deep learning, Robomech J., 6 (13) (2019).
  • Selvaraj, A., Shebiah, N., Nidhyananthan, S., Ganesan, L., Fruit recognition using color and texture features, J. Emerg. Trends Comput. Inf. Sci., 1 (2010), 90-94.
  • Bulanon, D. M., Kataoka, T., Ota, Y., Hiroma, T., AE-Automation and emerging technologies: A segmentation algorithm for the automatic recognition of fuji apples at harvest, Biosyst. Eng., 83 (4) (2002), 405-412.
  • Liu, X., Zhao, D., Jia, W., Ji, W., & Sun, Y., A detection method for apple fruits based on color and shape features, IEEE Access, 7 (2019), 67923–67933.
  • Mao, W., Ji, B., Zhan, J., Zhang, X. and Hu, X., Apple location method for the apple harvesting robot, 2009 2nd International Congress on Image and Signal Processing, (2009),1-5.
  • Tanigaki, K., Fujiura, T., Akase, A., Imagawa, J., Cherry-harvesting robot, Comput. Electron. Agric., 63 (1) (2008), 65-72.
  • Ji, W., Zhao, D., Cheng, F., Xu, B., Zhang, Y., Wang, J., Automatic recognition vision system guided for apple harvesting robot, Comput. Elec. Eng., 38 (5) (2012), 1186-1195.
  • Kurtulmus, F., Lee, W.S., Vardar, A., Immature peach detection in colour images acquired in natural illumination conditions using statistical classifiers and neural network, Precision Agric., 15 (2014) 57–79.
  • Song, Y., Glasbey, C. A., Horgan, G. W., Polder, G., Dieleman, J. A., van der Heijden, G. W. A. M., Automatic fruit recognition and counting from multiple images, Biosyst. Eng., 118 (2014), 203-215, https://doi.org/10.1016/j.biosystemseng.2013.12.008.
  • Islam, M. A., Yousuf, Md. S. I., Billah, M. M., Automatic plant detection using HOG and LBP features with SVM, Int. J. Comput., 33 (1) (2019), 26-38.
  • Hummel, R. A., Image enhancement by histogram transformation, Comput. Graphics Image Process., 6 (1977), 184-195.
  • Ketcham, D. J., Lowe, R. W. and Weber, J. W., Real-time image enhancement techniques, Seminar on Image Processing, (1976), 1-6.
  • Pizer, S. M., Intensity mappings for the display of medical images, Functional Mapping of Organ Systems and Other Computer Topics, Society of Nuclear Medicine (1981).
  • Pizer, S. M., Amburn, E. P., Austin, J. D., et al., Adaptive histogram equalization and its variations, Computer Vision, Graphics, and Image Processing, 39 (1987), 355-368.
  • Maison, Lestari, T., Luthfi, A., Retinal blood vessel segmentation using gaussian filter, J. Phys.: Conf. Ser., 1376 (2019), 012023, https://doi.org/10.1088/1742-6596/1376/1/012023.
  • Umri, B. K., Utami, E. and Kurniawan, M. P., Comparative analysis of CLAHE and AHE on application of CNN algorithm in the detection of Covid-19 patients, 2021 4th Int. Conf. on Inf. and Comm. Tech. (ICOIACT), (2021), 203-208, https://doi.org/10.1109/ICOIACT53268.2021.9563980.
  • Wang, Q., Lu, Y., Zhang, X., Hahn, J., Region of interest selection for functional features, Neurocomputing, 422 (2021), 235-244.
  • Zhang, L., Sun, Q. and Zhang, J., Region of interest extraction via common salient feature analysis and feedback reinforcement strategy for remote sensing images, GI Science Remote Sens., 55 (5) (2018), 745-762.
  • Vogt, P., Riitters, K. H., Estreguil, C., Kozak, J., Wade, T. G., Wickham, J. D. , Mapping spatial patterns with morphological, Image Processing, 22 (2) (2007), 171-177.
  • [21] Dalal, N. and Triggs, B., Histograms of oriented gradients for human detection, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), (2005), 886-893.
  • Tuncer, T. and Avcı, E., Yerel ikili örüntü tabanlı veri gizleme algoritması: LBP-LSB, Türkiye Bilişim Vakfı Bilgisayar Bilimleri ve Mühendisliği Dergisi, 10 (1) (2017) 48-53.
  • Chen, J., Kellokumpu, V., Zhao, G., Pietikainen, M., RLBP: Robust Local Binary Pattern, Proceedings British Machine Vision Conference 2013, 122 (2014),1-11, http://dx.doi.org/10.5244/C.27.122.
  • Cortes, C. and Vapnik, V., Support-Vector Networks, Mach. Learn., 20 (1995), 273-297, http://dx.doi.org/10.1007/BF00994018.
  • [Kuang, Q. and Zhao, L., A practical GPU based KNN algorithm, Proceedings of the Second Symposium International Computer Science and Computational Technology (ISCSCT '09), (2009), 151-155.
  • Li, H., Chen, L., Removal of false positive in object detection with contour-based classifiers, 2010 IEEE International Conference on Image Processing, (2010), 3941-3944.
  • Rothe, R., Guillaumin, M., Van Gool, L., Non-maximum suppression for object detection by passing messages between windows, Computer Vision ACCV 2014, 9003 (2015), 290-306, https://doi.org/10.1007/978-3-319-16865-4_19.
  • Salscheider, N. O., FeatureNMS: Non-maximum suppression by learning feature embeddings, 25th International Conference on Pattern Recognition (ICPR), (2020), 7848-7854.
  • Liu, G., Mao, S., Open tomatoes dataset, (2019). Available at: https://github.com/pandalgx/Tomato-dataset. [Accessed February 2023].
There are 29 citations in total.

Details

Primary Language English
Subjects Engineering
Journal Section Research Articles
Authors

Hakki Alparslan Ilgın 0000-0003-0112-4833

Fevzi Anıl Aydemir This is me 0000-0002-6530-3040

Berkay Cedimoğlu This is me 0000-0002-2179-9566

Muhammet Nurullah Aydın 0000-0002-4026-9739

Turkey-hasan Silleli 0000-0003-2242-3402

Project Number 7201372
Early Pub Date October 7, 2023
Publication Date December 29, 2023
Submission Date April 1, 2023
Acceptance Date May 8, 2023
Published in Issue Year 2023 Volume: 65 Issue: 2

Cite

APA Ilgın, H. A., Aydemir, F. A., Cedimoğlu, B., Aydın, M. N., et al. (2023). Comparative analysis of mature tomato detection by feature extraction and machine learning for autonomous greenhouse robots. Communications Faculty of Sciences University of Ankara Series A2-A3 Physical Sciences and Engineering, 65(2), 100-114. https://doi.org/10.33769/aupse.1274677
AMA Ilgın HA, Aydemir FA, Cedimoğlu B, Aydın MN, Silleli Th. Comparative analysis of mature tomato detection by feature extraction and machine learning for autonomous greenhouse robots. Commun.Fac.Sci.Univ.Ank.Series A2-A3: Phys.Sci. and Eng. December 2023;65(2):100-114. doi:10.33769/aupse.1274677
Chicago Ilgın, Hakki Alparslan, Fevzi Anıl Aydemir, Berkay Cedimoğlu, Muhammet Nurullah Aydın, and Turkey-hasan Silleli. “Comparative Analysis of Mature Tomato Detection by Feature Extraction and Machine Learning for Autonomous Greenhouse Robots”. Communications Faculty of Sciences University of Ankara Series A2-A3 Physical Sciences and Engineering 65, no. 2 (December 2023): 100-114. https://doi.org/10.33769/aupse.1274677.
EndNote Ilgın HA, Aydemir FA, Cedimoğlu B, Aydın MN, Silleli T-h (December 1, 2023) Comparative analysis of mature tomato detection by feature extraction and machine learning for autonomous greenhouse robots. Communications Faculty of Sciences University of Ankara Series A2-A3 Physical Sciences and Engineering 65 2 100–114.
IEEE H. A. Ilgın, F. A. Aydemir, B. Cedimoğlu, M. N. Aydın, and T.-h. Silleli, “Comparative analysis of mature tomato detection by feature extraction and machine learning for autonomous greenhouse robots”, Commun.Fac.Sci.Univ.Ank.Series A2-A3: Phys.Sci. and Eng., vol. 65, no. 2, pp. 100–114, 2023, doi: 10.33769/aupse.1274677.
ISNAD Ilgın, Hakki Alparslan et al. “Comparative Analysis of Mature Tomato Detection by Feature Extraction and Machine Learning for Autonomous Greenhouse Robots”. Communications Faculty of Sciences University of Ankara Series A2-A3 Physical Sciences and Engineering 65/2 (December 2023), 100-114. https://doi.org/10.33769/aupse.1274677.
JAMA Ilgın HA, Aydemir FA, Cedimoğlu B, Aydın MN, Silleli T-h. Comparative analysis of mature tomato detection by feature extraction and machine learning for autonomous greenhouse robots. Commun.Fac.Sci.Univ.Ank.Series A2-A3: Phys.Sci. and Eng. 2023;65:100–114.
MLA Ilgın, Hakki Alparslan et al. “Comparative Analysis of Mature Tomato Detection by Feature Extraction and Machine Learning for Autonomous Greenhouse Robots”. Communications Faculty of Sciences University of Ankara Series A2-A3 Physical Sciences and Engineering, vol. 65, no. 2, 2023, pp. 100-14, doi:10.33769/aupse.1274677.
Vancouver Ilgın HA, Aydemir FA, Cedimoğlu B, Aydın MN, Silleli T-h. Comparative analysis of mature tomato detection by feature extraction and machine learning for autonomous greenhouse robots. Commun.Fac.Sci.Univ.Ank.Series A2-A3: Phys.Sci. and Eng. 2023;65(2):100-14.

Communications Faculty of Sciences University of Ankara Series A2-A3 Physical Sciences and Engineering

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.