Shopping Robot That Make Real Time Color Tracking Using Image Processing Techniques

Year 2017, Volume: 5 Issue: 3, 62 - 66, 01.10.2017

Muhammet Fatih Aslan , Akif Durdu Kadir Sabancı

https://doi.org/10.18100/ijamec.2017331881

Cited By: 4

Abstract

Robots are human-designed, autonomous electro-mechanical devices to perform tasks assigned to them. It is considered that robots will work more efficiently, better quality and more economical than humans. For this reason, the use of robots in different areas is increasing day by day. This work can contribute to Industry 4.0, which is called the revolution of the future. In this study, we developed a service robot for shopping. Thanks to the designed market robot, market owners will be able to offer easier, more enjoyable and faster service to all customers, especially disabled people and elderly people who are shopping. In this work, the images recorded by the high resolution camera are processed in real time and the target tracking is performed. The study consists of two phases; software and hardware. During the hardware phase, the design and implementation of the used robot is done. In practice, omni wheels are used to increase the flexibility of motion of the robot. In the software phase, the image processing software and the designed algorithm are introduced. During the image processing phase, the C ++ software language is used with the OpenCV library. With the designed algorithm, software and hardware, real-time target tracking has been successfully implemented. The tracking of the customer in the markets can be carried out by different methods such as radio frequency (RF), wireless communication. However, this study is important in terms of the first study for a robot of this kind. In this way, new ideas will be revealed.

Keywords

C++, Embedded systems, Image processing, Industry 4.0, Omni Wheel, OpenCV, Real Time Target Tracking, Shopping Robot

References

• G. Samtaş, M. Gülesin, “Sayısal Görüntü İşleme Farklı Alanlardaki Uygulamaları,” Electronic Journal of Vocational Colleges, vol.2 no. 1, May 2011.
• T. Ebata, M. Ito and M. Shibata, “Visual feedback control method of a wheeled mobile robot using a pan camera preferentially,” IEEE 13th International Workshop on Advanced Motion Control (AMC), pp. 149-154, 2014.
• K. Hashimoto, “A review on vision-based control of robot manipulators,” Advanced Robotics, vol. 17, no. 1, pp. 969–991, 2003
• M. Clark, D. Feldpausch and G. S. Tewolde, “Microsoft kinect sensor for real-time color tracking robot,” IEEE International Conference on Electro/Information Technology, pp. 416-421, 2014
• N. Masud et al., “FPGA based Multiprocessor Embedded System for Real-Time Image Processing,” 15th International Conference on Control, Automation and Systems (ICCAS), pp. 436-438, 2015
• T. Schmitt et al. “Cooperative Probabilistic State Estimation for Vision-Based Autonomous Mobile Robots,” IEEE Transactions on Robotics and Automation, vol. 18 no. 5, pp. 670–684, 2002.
• M. Peker, A. Zengin, “Gerçek Zamanlı Harekete Duyarlı Bir Görüntü Tanıma Sistemi,” 6th International Advanced Technologies Symposium (IATS’11), 2011.
• S. Erdogdu, “Karmasık Algoritmaların Gerçek Zamanlı Gömülü Sistemlerde Gerçeklenmesi,” ASELSAN AŞ., Savunma Sistem Teknolojileri (SST) Grubu, Ankara, 4. Ulusal Yazılım Mühendisliği Sempozyumu, 2009.
• H. Hagiwara, K. Asami and M. Komori, “Real-time image processing system by using FPGA for service robots,” 1st IEEE Global Conference on Consumer Electronics, pp. 720-723, 2012.
• S. M. A. Shah et al. “Robustness testing of embedded software systems: an industrial interview study,” IEEE Access, vol. 4, pp. 1859-1871, 2016.
• [Online]. Available: http://matlabgoruntuisleme.blogspot.com.tr/2012 /09/rgbhsvycbcr-renk-uzaylar-md2.html
• İ. Başlar, “Tüm Gökyüzü Kamerasından Alınan Görüntüler Kullanılarak Bulutluluk Ölçümü Yapılması,” Türkiye Bilimsel Ve Teknolojik Araştırma Kurumu, 2012