El Hareketleri ile Mutfak Gereçlerinin Temassız Kontrolü: Sanal Ocak Üzerine Bir Uygulama Arayüzü

Öz

Günümüzde çeşitli sensörler vasıtasıyla, sanal ve gerçek dünya arasında, insan bilgisayar etkileşimini sağlayan arayüzler ve bunların ergonomisi üzerine çalışmaların arttığını gözlemlemekteyiz. İnsan-bilgisayar etkileşiminin ergonomisi ile ilgili genel çerçeve ISO 92411-960 standartları içinde tanımlanlansa da, ortaya çıkan yeni sensörler, ile, her dönem güncellenmeye muhtaç kapsamlar olacağını öngörmekteyiz. Sözlü olmayan evrensel bir iletişim aracı olarak el hareketleri ise, bilgisayar insan etkileşimi sistemleri araştırmacıları tarafından kullanılmaktadır. Bu çalışmada sunulduğu üzere, Leap Motion hareket sensörü vasıtasıyla, naturel el hareketlerini algılanıp, tanımlayarak, Unity3D ortamında oluşturulan bir arayüzle etkileşim sağlanmıştır. Arayüz üzerine yerleştirilen 3D sanal ocak modeli, el hareketleri ile kontrol edilebilirken, aynı zamanda gerçek dünyaya sinyaller gönderilebilmektedir. Bu durumda, bu çalışmada hedef olarak seçilen bir ankastre ocak gibi, üzerinde mikroişlemci barındıran herhangi bir mutfak gerecinin kontrolü mümkündür Çalışmada gerçek ocağın simülasyonu, Arduino kartı ve buna entegre edilen LED’ler ile yapıldı. Sanal ortamda, ocak fonksiyonları, Arduino seri haberleşmesi üzerinden kontrol edilen LED’lerin tepkisine göre değerlendirilmektedir.

Anahtar Kelimeler

• El hareket tanımlama
• Temassız kontrol
• İnsan bilgisayar etkileşimi ergonomisi
• Sanal-Karma gerçeklik
• Human computer interaction

Electrical Home Appliances Control Interface Design Based on Hand Gesture Identification : An Application on Virtual Hob

Abstract

Nowadays, we observe an increasing number of studies on interfaces that provide human-computer interaction between the virtual and real world, and their ergonomics, through various sensors. Although the general framework regarding the ergonomics of human-computer interaction is defined by ISO 92411-960 standards, we foresee that there will be scopes that need to be updated every period with the developments in the areas such as new sensors. Hand gestures are already used by computer-human interaction systems researchers as a universal non-verbal communication tool. As presented in this study, natural hand movements are detected and defined by the Leap Motion motion sensor and interacted with an interface created in the Unity3D environment. The 3D virtual furnace model placed on the interface can be controlled by hand movements while simultaneously sending signals to the real world. In this case, it is possible to control any kitchen appliances that have a microprocessor on them, such as a hob, which was chosen as the target in this study. In the study, the simulation of the actual hob was conducted with an Arduino and integrated LEDs. In the virtual environment, the hob functions are evaluated according to the response of the LEDs controlled via Arduino serial communication.

Keywords

• Hand gesture identification
• Non-contact control
• Virtual-Mixed reality
• Human computer interaction

Kaynakça

1. Kela, Korpipää, Mäntyjärvi, Kallio, Savino, Jozzo, et al., Accelerometer-based gesture control for a design environment, Personal and Ubiquitous Computing, vol. 10, no. 5, pp. 285-299, 2006
2. Rahmat, Hasibuan, Siregar, Syahputra, (2018). A Traditional Bekel Game Using Leap Motion Controller. Journal of Physics Conference Series 1116(2):022036.
3. Cho, Lee (2014). A Study about Honey Bee Dance Serious Game for Kids Using Hand Gesture: International Journal of Multimedia and Ubiquitous Engineering 9(6):397-404.
4. Mohandes, Aliyu, Deriche (2014). Arabic Sign Language Recognition Using the Leap Motion Controller. 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE)
5. Potter, Araullo, Carter (2013). The Leap Motion Controller: A View On Sign Language. Conference: Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration.
6. Demircioglu,Bulbul, Kose (2016). Turkish Sign Language Recognition with Leap Motion. Conference: 2016 24th Signal Processing and Communication Application Conference (SIU).
7. Nainggolan, Siregar, Fahmi (2016). Anatomy learning system on human skeleton using Leap Motion Controller, 3rd International Conference on Computer and Information Sciences (ICCOINS).
8. Zaiţi, Pentiuc, Vatavu (2015). On free-hand TV control: experimental results on user-elicited gestures with Leap Motion. Personal and Ubiquitous Computing volume 19, pages 821–838.

9. Zhongliu, Xin (2019). Research on Interactive System of Science Exhibition Based on Leap Motion,IOP Conference Series Materials Science and Engineering 686(1):012011.
10. Mohandes, Aliyu, Deriche (2014). Arabic sign language recognition using the leap motion controller, Institute of Electrical and Electronics Engineers Inc.10.1109/ISIE.2014.6864742.
11. Santhanakrishnan, ReddyYerasi, Singh. (2020). Hand Gesture Based Home Automation Using Leap Motion Sensor. International Journal of Advanced Science and Technology, 29(6s), 1926 - 1931
12. Spiegelmock, Mischa. Leap Motion Development Essentials. Sayfa 6 Packt Publishing, 2013
13. Tang, Webb (2018). The Design and Evaluation of an Ergonomic Contactless Gesture Control System for Industrial Robots: Journal of Robotics Volume 2018, Article ID 9791286.
14. Time of Flight Kameralar Erişim Adresi: https://en.wikipedia.org/wiki/Time_of_flight
15. Microsoft Kinect, Erişim Adresi: https://learn.microsoft.com/en-us/windows/apps/design/devices/kinect-for-windows
16. Hololens Erişim Adresi: [https://www.microsoft.com/en-us/hololens]teknolojileri
17. How Leap Motion Works, UltraLeap, Erişim Adresi: https://www.ultraleap.com/company/news/blog/how-hand-tracking-works/
18. Unity 3D için Erişim Adresi: https://unity.com/
19. Microsoft C# için Erişim Adresi: https://learn.microsoft.com/en-us/dotnet/csharp/
20. Arduino için Erişim Adresi: https://www.arduino.cc/
21. https://link.springer.com/conference/gw
22. Human-Computer Interaction ISO Standarts için Erişim Adresi: https://www.iso.org/obp/ui/#iso:std:iso:9241:-960:ed-1:v1:en
23. UltraLeap Erişim Adresi: https://www.ultraleap.com/
24. Leap Motion and Kiosk Projects, UltraLeap, Erişim Adresi: https://www.ultraleap.com/success-kiosk-product-catalogue/
25. Leap Motion Camera Position Visualiser, Erişim Adresi: https://docs.ultraleap.com/CameraPositionVisualizer/
26. RULA Table, Erişim Adresi: https://ergo-plus.com/wp-content/uploads/RULA-A-Step-by-Step-Guide1.pdf
27. RULA analysis Online, Erişim Adresi: https://www.rula.co.uk/assessment.html (Erişim Tarihi
28. Solidworks için Erişim Adresi: https://www.solidworks.com/
29. Leap Motion Orion Erişim Adresi: https://developer.leapmotion.com/releases/leap-motion-orion-410-99fe5-crpg
30. Uduino, Asset Store, Erişim Adresi: https://assetstore.unity.com/packages/tools/input-management/uduino-arduino-communication-simple-fast-and-stable-78402