Controlling A Robotic Arm Using Hand Recognition Software

Abstract

With the increasing need of repetitive tasks in the manufacturing industry, robotic automation is becoming a necessity. In the steel industry, workers become less efficient over time, causing interruptions during assembly. Robotic automation is capable of operating at highest efficiency therefore increasing productivity in the steel industry. The robot will be able to pick up and drop metallic object with the help of the electromagnet present on the robotic arm. The handling of the objects will be triggered by the hand gestures from the user. The image to be processed will be captured by an external camera. This robot is built as a prototype for the steel industry. 

Keywords

• Gesture Recognition,OpenCV,Embedded System Robotic Arm Control,Embedded C.

References

1. E. B. Mathew, D. Khanduja, B. Sapra, B. Bhushan, Robotic arm control through human arm movement detection using potentiometers, International Conference on Recent Developments in Control, Automation and Power Engineering, 2015.
2. B. İşçimen, H. Atasoy, Y. Kutlu, S. Yıldırım, E. Yıldırım, Smart robot arm motion using computer vision, Elektronika Ir Elektrotechnika, ISSN 1392-1215.
3. M. A. Jayaram, H. Fleyeh, Convex hulls in image processing: a scoping review, American Journal of Intelligent Systems, 2016.
4. OpenCV library document, https://opencv.org/
5. Structural Analysis and Shape Descriptors, OpenCV “2.4.13.7 documentation”. https://docs.opencv.org
6. A. Dhawan, A. Bhat, S. Sharma, H. K. Kaura, Automated robot with object recognition and handling features, International Journal of Electronics and Computer Science Engineering, ISSN 2277-1956/V2N3-861-873.
7. Abhishek Chavan, Abhishek Bhuskute, Anmol Jain, Dynamics of robotic arm, International Journal of Computer Applications (0975 – 8887), 2014.
8. C. Manresa, J. Varona, R. Mas, F. J. Perales, ‘‘Hand tracking and gesture recognition for human-computer interaction’’, Electronic Letters on Computer Vision and Image Analysis 5(3):96-104, 2005.

9. P. Xu, A real-time hand gesture recognition and humancomputer interaction system, arXiv:1704.07296v1 [cs.CV] 24 Apr 2017.
10. A. Soetedjo, I.K. Somawirata, A. Irawan, ‘‘Human arm movement detection using low-cost sensors for controlling robotic arm’’, Journal of Telecommunication, Electronic and Computer Engineering, e-ISSN: 2289-8131 Vol. 10 No. 2-3.
11. A. Alam, T. Rana, M. Hashemy, An autonomous detective robotic arm, International Conference on Mechanical, Industrial and Materials Engineering 2017.