Performance Comparison in R-CNN and Dalle-3 Based Image Processing

Abstract

Image processing involves the manipulation and analysis of digital images. Artificial intelligence encompasses technologies that mimic human intelligence. The integration of these two fields provides improvements in terms of efficiency and accuracy in applications such as automatic image recognition, object detection and classification. In this context, Faster R-CNN deep learning model and Dalle-3 artificial intelligence program were analyzed with descriptive statistics method using Python. In this process, object recognition and tracking abilities in the fields of art and design, educational technologies and security systems were evaluated in terms of creativity and limited to the Faster R-CNN deep learning model and Dalle-3 artificial intelligence by adopting comparative analysis and logical reasoning techniques from qualitative research methods. The findings show that deep learning and object detection technologies have significant potential to solve complex image processing problems and enhance creative problem solving capacities. The results reveal that these technologies have strategic advantages and the ability to provide creative solutions even under challenging visual factors, and provide recommendations for future use and development.

Keywords

• Image Processing
• Deep Learning
• Object Tracking
• Artificial Intelligence
• R-CNN

R-CNN ve Dalle-3 Tabanlı Görüntü İşlemede Performans Karşılaştırması

Abstract

Görüntü işleme, dijital görüntülerin manipülasyonu ve analizini içerir. Yapay zeka, insan zekâsını taklit eden teknolojileri kapsar. Bu iki alanın entegrasyonu, otomatik görüntü tanıma, nesne tespiti ve sınıflandırma gibi uygulamalarda verimlilik ve doğruluk açısından iyileştirmeler sağlamaktadır. Bu çerçevede araştırma kapsamında, Faster R-CNN derin öğrenme modeli ve Dalle-3 yapay zeka programı, Python kullanılarak betimsel istatistik yöntemi ile incelenmiştir. Bu süreçte, sanat ve tasarım, eğitim teknolojileri ve güvenlik sistemleri alanlarında nesne tanıma ve takip yetenekleri yaratıcılık açısından değerlendirilmiş olup, nitel araştırma yöntemlerinden karşılaştırmalı analiz ve mantıksal akıl yürütme teknikleri benimsenerek, Faster R-CNN derin öğrenme modeli ve Dalle-3 yapay zekası ile sınırlandırılmıştır. Bulgular, derin öğrenme ve nesne tespiti teknolojilerinin karmaşık görüntü işleme sorunlarını çözme ve yaratıcı problem çözme kapasitelerini geliştirme konusunda önemli bir potansiyele sahip olduğunu. Sonuçlar, bu teknolojilerin zorlayıcı görüntüsel faktörler altında bile yaratıcı çözümler sunabilme yeteneğine ve stratejik avantajlara sahip olduğunu ortaya koyarak, ileriye dönük kullanım ve geliştirme için önerilerde bulunmuştur.

Keywords

• Görüntü İşleme
• Derin Öğrenme
• Nesne Takibi
• Yapay Zeka
• R-CNN

References

1. Russell, S. J., & Norvig, P. (2016). Artificial intelligence: a modern approach. Pearson.
2. Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. MIT press.
3. McCulloch, W. S., & Pitts, W. (1943). A logical calculus of the ideas immanent in nervous activity. The bulletin of mathematical biophysics, 5, 115-133.
4. Schmidhuber, J. (2015). Deep learning in neural networks: An overview. Neural networks, 61, 85-117.
5. LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. nature, 521(7553), 436-444.
6. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 25.
7. Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014). Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 580-587).
8. Girshick, R. (2015). Fast r-cnn. In Proceedings of the IEEE international conference on computer vision (pp. 1440-1448).

9. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 25.
10. He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
11. Ren, S., He, K., Girshick, R., & Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28.
12. He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017). Mask r-cnn. In Proceedings of the IEEE international conference on computer vision (pp. 2961-2969).
13. Dai, J., Li, Y., He, K., & Sun, J. (2016). R-fcn: Object detection via region-based fully convolutional networks. Advances in neural information processing systems, 29.
14. Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., ... & Sutskever, I. (2021, July). Zero-shot text-to-image generation. In International conference on machine learning (pp. 8821-8831). Pmlr.
15. Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022). Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125, 1(2), 3.
16. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., ... & Bengio, Y. (2014). Generative adversarial nets. Advances in neural information processing systems, 27.
17. Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI blog, 1(8), 9.
18. Özdal, M. A. (2023). Yapay Zekâ İle Oluşturulan Eserlerin Telif Hakkı Ve Kişisel Verilerin Korunması. Hakkari Review, 7(1), 90-110.
19. Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021, March). On the dangers of stochastic parrots: Can language models be too big?. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency (pp. 610-623).
20. Ren, S., He, K., Girshick, R., & Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28.
21. Uijlings, J. R., Van De Sande, K. E., Gevers, T., & Smeulders, A. W. (2013). Selective search for object recognition. International journal of computer vision, 104, 154-171.
22. Özdal, M. A. (2020). Dijital Sanatta Gerçekliğin Yeri. Uluslararası Sanat Tasarım ve Eğitim Dergisi, 4(2), 11-21.
23. He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
24. Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014). Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 580-587).
25. Dai, J., Li, Y., He, K., & Sun, J. (2016). R-fcn: Object detection via region-based fully convolutional networks. Advances in neural information processing systems, 29.
26. Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., ... & Sutskever, I. (2021, July). Zero-shot text-to-image generation. In International conference on machine learning (pp. 8821-8831). Pmlr.
27. Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022). Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125, 1(2), 3.
28. Özdal, M. A. (2024). Yapay zekâ ile üretilen görsel ve illüstrasyon eserlerinin telif hakları ve kişisel veri güvenliği. Disiplinlerarası Yenilik Araştırmaları Dergisi, 4(1), 7-31.
29. Uijlings, J. R., Van De Sande, K. E., Gevers, T., & Smeulders, A. W. (2013). Selective search for object recognition. International journal of computer vision, 104, 154-171.
30. Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., ... & Sutskever, I. (2021, July). Zero-shot text-to-image generation. In International conference on machine learning (pp. 8821-8831). Pmlr.
31. Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022). Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125, 1(2), 3.
32. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., ... & Bengio, Y. (2014). Generative adversarial nets. Advances in neural information processing systems, 27.
33. Chakraborty, T., KS, U. R., Naik, S. M., Panja, M., & Manvitha, B. (2024). Ten years of generative adversarial nets (GANs): a survey of the state-of-the-art. Machine Learning: Science and Technology, 5(1), 011001.
34. Tan, B., Li, Y., Zhao, H., Li, X., & Ding, S. (2020). A novel dictionary learning method for sparse representation with nonconvex regularizations. Neurocomputing, 417, 128-141.
35. İnik, Ö., & Ülker, E. (2017). Derin öğrenme ve görüntü analizinde kullanılan derin öğrenme modelleri. Gaziosmanpaşa Bilimsel Araştırma Dergisi, 6(3), 85-104.
36. Chollet, F. (2017). Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1251-1258).
37. Ma, Z., Wei, X., Hong, X., & Gong, Y. (2019). Bayesian loss for crowd count estimation with point supervision. In Proceedings of the IEEE/CVF international conference on computer vision (pp. 6142-6151).
38. LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. nature, 521(7553), 436-444.
39. Schmidhuber, J. (2015). Deep learning in neural networks: An overview. Neural networks, 61, 85-117.
40. Ren, S., He, K., Girshick, R., & Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems, 28.
41. Girshick, R. (2015). Fast r-cnn. In Proceedings of the IEEE international conference on computer vision (pp. 1440-1448).
42. He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
43. Lin, T. Y., Dollár, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017). Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2117-2125).
44. Kantor, C., Rauby, B., Boussioux, L., Jehanno, E., & Talbot, H. (2020). Over-CAM: Gradient-Based Localization and Spatial Attention for Confidence Measure in Fine-Grained Recognition using Deep Neural Networks.
45. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C. Y., & Berg, A. C. (2016). Ssd: Single shot multibox detector. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14 (pp. 21-37). Springer International Publishing.
46. Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 779-788).
47. Leng, G. (2018). The heart of the brain: the hypothalamus and its hormones. MIT Press.
48. Kantor, C., Rauby, B., Boussioux, L., Jehanno, E., & Talbot, H. (2020). Over-CAM: Gradient-Based Localization and Spatial Attention for Confidence Measure in Fine-Grained Recognition using Deep Neural Networks.
49. Lin, T. Y., Dollár, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017). Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2117-2125).
50. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C. Y., & Berg, A. C. (2016). Ssd: Single shot multibox detector. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14 (pp. 21-37). Springer International Publishing.
51. Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 779-788).
52. Kantor, C., Rauby, B., Boussioux, L., Jehanno, E., & Talbot, H. (2020). Over-CAM: Gradient-Based Localization and Spatial Attention for Confidence Measure in Fine-Grained Recognition using Deep Neural Networks.
53. Lin, T. Y., Dollár, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017). Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2117-2125).
54. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C. Y., & Berg, A. C. (2016). Ssd: Single shot multibox detector. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14 (pp. 21-37). Springer International Publishing.
55. Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., ... & Sutskever, I. (2021, July). Zero-shot text-to-image generation. In International conference on machine learning (pp. 8821-8831). Pmlr.
56. Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 779-788).
57. Özdal, M. A. Yapay Zeka Destekli Grafik Tasarımın Yasal Boyutu. Uluslararası İşletme Bilimi ve Uygulamaları Dergisi, 3(2), 53-78.
58. He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
59. Leng, G. (2018). The heart of the brain: the hypothalamus and its hormones. MIT Press.
60. Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 779-788).
61. Chollet, F. (2017). Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1251-1258).
62. Lin, T. Y., Dollár, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017). Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2117-2125).
63. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C. Y., & Berg, A. C. (2016). Ssd: Single shot multibox detector. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14 (pp. 21-37). Springer International Publishing.
64. Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017). Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4700-4708).
65. Kantor, C., Rauby, B., Boussioux, L., Jehanno, E., & Talbot, H. (2020). Over-CAM: Gradient-Based Localization and Spatial Attention for Confidence Measure in Fine-Grained Recognition using Deep Neural Networks.
66. Ramesh, A., Pavlov, M., Goh, G., Gray, S., Voss, C., Radford, A., ... & Sutskever, I. (2021, July). Zero-shot text-to-image generation. In International conference on machine learning (pp. 8821-8831). Pmlr.
67. He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
68. Chollet, F. (2017). Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1251-1258).
69. Lin, T. Y., Dollár, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017). Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2117-2125).
70. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C. Y., & Berg, A. C. (2016). Ssd: Single shot multibox detector. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14 (pp. 21-37). Springer International Publishing.
71. Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017). Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4700-4708).
72. Kantor, C., Rauby, B., Boussioux, L., Jehanno, E., & Talbot, H. (2020). Over-CAM: Gradient-Based Localization and Spatial Attention for Confidence Measure in Fine-Grained Recognition using Deep Neural Networks.
73. Sapkota, R., Ahmed, D., & Karkee, M. (2024). Creating Image Datasets in Agricultural Environments using DALL. E: Generative AI-Powered Large Language Model. E: Generative AI-Powered Large Language Model (March 24, 2024).
74. Li, H., Gu, J., Koner, R., Sharifzadeh, S., & Tresp, V. (2023). Do Dalle and flamingo understand each other?. In Proceedings of the IEEE/CVF International Conference on Computer Vision (pp. 1999-2010).
75. Ge, Y., Xu, J., Zhao, B. N., Joshi, N., Itti, L., & Vineet, V. (2022). Dalle for Detection: Language-driven Compositional Image Synthesis for Object Detection. arXiv preprint arXiv:2206.09592.
76. Russell[1] From Faster R-CNN to Mask R-CNN. (2022), https://elifmeseci.medium.com/r-cnn-ailesi-part-ii-76cce9e4a9d6, Accessed March 13, 2024.
77. Chess pieces created with Dalle-3 Artificial intelligence program. (2024), https://chatgpt.com/g/g-2fkFE8rbu-dall-e/c/4cbf365e-845e-4c59-b2e7-327942906b18,Erişim Date: April 10, 2024.
78. Human Face Prototype created with Dalle-3 Artificial intelligence program. (2024), https://chatgpt.com/g/g-2fkFE8rbu-dall-e/c/4cbf365e-845e-4c59-b2e7-327942906b18,Erişim Date: April 17, 2024.
79. Comparison of Chess Pieces and Human Face created with Dalle-3 artificial intelligence program with artificial intelligence using Faster R-CNN model. (2024), https://chatgpt.com/g/g-2fkFE8rbu-dall-e/c/4cbf365e-845e-4c59-b2e7-327942906b18, Access Date: 18 April 2024.
80. Python Statistical Performance Analysis of the Object and Face Recognition Process Using Faster R-CNN and Dalle-3 Models. (2024), https://www.python.org/, Access Date: 12 May 2024.
81. Python Statistical Analysis of the Effects of Faster R-CNN and Dalle-3 Models on Creativity. Applications on Art, Educational Technologies and Security Systems. (2024), https://www.python.org/, Accessed May 15, 2024.
82. Accuracy - Loss graph showing model performance (2024), https://chatgpt.com/c/670af7ee-96e8-8001-bccf-6c4a0536cc64