Automatic Object Painting with SCARA Robot Using Computer Vision

Abstract

Recognizing and accurately classifying colors in industrial applications is a critical challenge in developing robotics painting applications. To achieve this, many painting robots are attached with expensive color sensors. However, these sensors are coming with many drawbacks such as color ranges limitation and sensitivity to illumination in addition to their high costs. In the last decades, camera systems gained importance in robotics applications with the power presented by the computer vision techniques. The main objective of this paper is to design an automation line that includes a robot and camera system to perform painting in different colors, with various illumination conditions at cheaper costs. The proposed system can be used to paint multiple colors effectively and accurately. The power of the system comes from the color detection and classification algorithm that is designed using computer vision techniques. The algorithm is designed under C++ environment using OpenCV library. The system will able to detect all colors that are adjusted/predefined offline by the user and to work in different illumination conditions. The end-effector of the robot consists of two main parts, a camera to detect the desired color and an automatic spray gun to perform the painting operation. The proposed system detects will do so based on a small sticker pasted on the object that will be painted. When the desired color is detected, the system starts the painting operation. Moreover, the system has the capability to automatically cleaning the spray gun and the connected tubes in the case of having the successive objects to be painted in different colors. 

Keywords

• Automatic Painting,Color Detection,Computer Vision,Painting Robot

References

1. A. Ata, A. Eleyan, Innovative Painting Robotic Cell for Industrial Applications, 3rd International Symposium on Innovative Technologies in Engineering and Science (ISITES2015), Valencia, Spain, June 2015.
2. A. Ata, A. Eleyan, An Autonomous Robotic Cell for Painting Applications, Proceedings of the IASTED In-ternational Conference Modelling, Identification and Control (MIC 2017), pp. 200-207, Innsbruck, Austria, February 2017.
3. A. Gasparetto, R. Vidoni, D. Pillan and E. Saccavini, “Automatic Path and Trajectory Planning for Robotic Spray Painting”, 7th German Conference on Robotics, pp. 5925 - 5930, May 2012
4. Z. Bo, F. Fang, S. Zhenhua, M. Zhengda and D. Xian-zhong, “Fast and Template Path Planning of Spray Painting Robots for Regular Surfaces”, 34th Chinese Control Conference (CCC), pp. 211- 216, July 2015
5. J. MU and Y. Li, “A New Efficient Real-Time Arbitrary Colored Ball Recognition Method for A Humanoid Soccer Robot”, 12th World Congress on Intelligent Control and Automation (WCICA), pp. 494 - 499, Sept 2016
6. K. J. Shin, “Detecting the Position of The Fish Robot Using the Color Segment Algorithm”, Future Technol-ogies Conference (FTC), pp. 896 - 900, Dec. 2016
7. R. Szabo, A. Gontean and A. Sfirat, “Robotic Arm Control in Space with Color Recognition Using a Raspberry Pi”, 39th International Conference on Tele-communications and Signal Processing (TSP), pp. 689 – 692, Dec. 2016
8. A.S Silva, F. Marcolino Q. Severgnini and M. L. Oliveira, “Object tracking by color and active contour model s segmentation”, IEEE Latin America Transac-tions, pp. 1488 - 1493, April 2016

9. M. Russell and S. Fischaber, “OpenCV Based Road Sign Recognition on Zynq”, 11th IEEE International Conference on Industrial Informatics (INDIN), pp. 596 - 601, July 2013
10. P. Constante, A. Gordon and O. Chang, “Artificial vision techniques for strawberry’s industrial classifica-tion”, IEEE Latin America Transactions, pp. 2576 - 2581, Aug. 2016