EOG-Based Eye-Writing Systems: 2013-2025 Review

Abstract

This paper comprehensively reviews eye-writing systems based on electrooculographic (EOG) signals. These systems, which enable communication by utilising the potential changes caused by eye movements, are generally classified into two main groups in the literature: virtual keyboard-based and pattern recognition-based. Virtual keyboard systems rely on thresholding methods and do not require artificial intelligence algorithms. On the other hand, in pattern recognition systems, character input is provided by users following specific eye movement patterns, and these patterns are analysed using artificial intelligence-based classification algorithms. In this context, the hardware, signal processing techniques, classification algorithms and interface designs have been systematically analysed by evaluating the studies published in the last twelve years. 

Keywords

• Eye-writing
• EOG
• Machine learning
• Pattern recognition
• Virtual keyboard

References

1. [1] Bulling, A., Ward, J. A., Gellersen, H., and Troster, G., "Eye movement analysis for activity recognition using electrooculography", IEEE Trans Pattern Anal Mach Intell, 33, (4): 741-53, Apr (2011). DOI: 10.1109/TPAMI.2010.86
2. [2] Barea, R., Boquete, L., Mazo, M., and López, E., "System for assisted mobility using eye movements based on electrooculography", IEEE transactions on neural systems and rehabilitation engineering, 10, (4): 209-218, (2002). DOI: 10.1109/TNSRE.2002.806829
3. [3] Bulling, A., Roggen, D., and Tröster, G., "Wearable EOG goggles: eye-based interaction in everyday environments," in CHI'09 Extended Abstracts on Human Factors in Computing Systems, 2009, pp. 3259-3264. DOI: 10.1145/1520340.1520468
4. [4] Zhu, X., Zheng, W.-L., Lu, B.-L., Chen, X., Chen, S., and Wang, C., "EOG-based drowsiness detection using convolutional neural networks," Proceedings of the 2014 International Joint Conference on Neural Networks (IJCNN), Beijing, China, (2014). DOI: 10.1109/IJCNN.2014.6889642
5. [5] Manabe, H. and Fukumoto, M., "Full-time wearable headphone-type gaze detector," Proceedings of the CHI'06 extended abstracts on Human factors in computing systems, (2006). DOI: 10.1145/1125451.1125655
6. [6] He, S. and Li, Y., "A single-channel EOG-based speller", IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25, (11): 1978-1987, (2017). DOI: 10.1109/TNSRE.2017.2716109
7. [7] Heo, J., Yoon, H., and Park, K. S., "A novel wearable forehead EOG measurement system for human computer interfaces", Sensors, 17, (7): 1485, (2017). DOI: 10.3390/s17071485
8. [8] Hou, H. K. and Smitha, K., "Low-cost wireless electrooculography speller," Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan, (2018). DOI: 10.1109/SMC.2018.00032

9. [9] Lingegowda, D. R., Amrutesh, K., and Ramanujam, S., "Electrooculography based assistive technology for ALS patients," Proceedings of the 2017 IEEE international conference on consumer electronics-Asia (ICCE-Asia), Bengaluru, India, (2017). DOI: 10.1109/ICCE-ASIA.2017.8307837
10. [10] Lledó, L. D., Úbeda, A., Iáñez, E., and Azorín, J. M., "Internet browsing application based on electrooculography for disabled people", Expert Systems with Applications, 40, (7): 2640-2648, (2013). DOI: 10.1016/j.eswa.2012.11.012
11. [11] López, A., Ferrero, F., Yangüela, D., Álvarez, C., and Postolache, O., "Development of a computer writing system based on EOG", Sensors, 17, (7): 1505, (2017). DOI: 10.3390/s17071505
12. [12] Chang, W.-D., Cha, H.-S., Kim, D. Y., Kim, S. H., and Im, C.-H., "Development of an electrooculogram-based eye-computer interface for communication of individuals with amyotrophic lateral sclerosis", Journal of neuroengineering and rehabilitation, 14: 1-13, (2017). DOI: 10.1186/s12984-017-0303-5
13. [13] Fang, F. and Shinozaki, T., "Electrooculography-based continuous eye-writing recognition system for efficient assistive communication systems", PloS one, 13, (2): e0192684, (2018). DOI: 10.1371/journal.pone.0192684
14. [14] Kang, D.-H. and Chang, W.-D., "Recognition of eye-written characters with limited number of training data based on a Siamese network", Electronics, 10, (23): 3009, (2021). DOI: 10.3390/electronics10233009
15. [15] Lee, K.-R., Chang, W.-D., Kim, S., and Im, C.-H., "Real-time “eye-writing” recognition using electrooculogram", IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25, (1): 37-48, (2016). DOI: 10.1109/TNSRE.2016.2542524
16. [16] Atmaji, C., Putra, A. E., and Hanif, A., "Sliding window method for eye movement detection based on electrooculogram signal," Proceedings of the 2018 International Conference on Information and Communications Technology (ICOIACT), Yogyakarta, Indonesia, (2018). DOI: 10.1109/ICOIACT.2018.8350779
17. [17] Ding, X. and Lv, Z., "Design and development of an EOG-based simplified Chinese eye-writing system", Biomedical Signal Processing and Control, 57: 101767, (2020). DOI: 10.1016/j.bspc.2019.101767
18. [18] Lu, Y., Zhang, C., Zhou, B.-Y., Gao, X.-P., and Lv, Z., "A dual model approach to EOG-based human activity recognition", Biomedical Signal Processing and Control, 45: 50-57, (2018). DOI: 10.1016/j.bspc.2018.05.011
19. [19] Saravanakumar, D. and Reddy, R., "A high performance asynchronous EOG speller system", Biomedical Signal Processing and Control, 59: 101898, (2020). DOI: 10.1016/j.bspc.2020.101898
20. [20] López, A., Arévalo, P., Ferrero, F., Valledor, M., and Campo, J., "EOG-based system for mouse control," Proceedings of the SENSORS, 2014 IEEE, Valencia, Spain, (2014). DOI: 10.1109/SSD.2014.6808755
21. [21] Soltani, S. and Mahnam, A., "Design of a novel wearable human computer interface based on electrooculograghy," Proceedings of the 2013 21st Iranian Conference on Electrical Engineering (ICEE), Mashhad, Iran, (2013). DOI: 10.1109/IranianCEE.2013.6599876
22. [22] Soltani, S. and Mahnam, A., "A practical efficient human computer interface based on saccadic eye movements for people with disabilities", Computers in biology and medicine, 70: 163-173, (2016). DOI: 10.1016/j.compbiomed.2016.01.012
23. [23] Yildiz, M. and Ülkütaş, H. Ö., "A new PC-based text entry system based on EOG coding", Advances in Human-Computer Interaction, 2018, (2018). DOI: 10.1155/2018/8528176
24. [24] Hossieny, R. R., Tantawi, M., Shedeed, H., and Tolba, M. F., "Development of electrooculogram based human computer interface system using deep learning", Bulletin of Electrical Engineering and Informatics, 12, (4): 2410-2420, (2023). DOI: 10.11591/eei.v12i4.5591
25. [25] Barbara, N. and Camilleri, T. A., "Interfacing with a speller using EOG glasses," Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary, (2016). DOI: 10.1109/SMC.2016.7844384
26. [26] Barbara, N., Camilleri, T. A., and Camilleri, K. P., "Comparative performance analysis of a commercial wearable EOG glasses for an asynchronous virtual keyboard," Proceedings of the Proceedings of the 32nd International BCS Human Computer Interaction Conference (HCI), (2018). DOI: 10.14236/ewic/HCI2018.6
27. [27] Barbara, N., Camilleri, T. A., and Camilleri, K. P., "EOG-based eye movement detection and gaze estimation for an asynchronous virtual keyboard", Biomedical Signal Processing and Control, 47: 159-167, (2019). DOI: 10.1016/j.bspc.2018.07.005
28. [28] Mifsud, M., Camilleri, T. A., and Camilleri, K. P., "HMM-based gesture recognition for eye-swipe typing", Biomedical Signal Processing and Control, 86: 105161, (2023). DOI: 10.1016/j.bspc.2023.105161
29. [29] Mifsud, M., Camilleri, T. A., and Camilleri, K. P., "A distance robust EOG-based feature for gaze trajectory inference", Biomedical Signal Processing and Control, 90: 105852, (2024). DOI: 10.1016/j.bspc.2023.105852
30. [30] Rakshit, A., Banerjee, A., and Tibarewala, D., "Electro-oculogram based digit recognition to design assitive communication system for speech disabled patients," Proceedings of the 2016 International Conference on Microelectronics, Computing and Communications (MicroCom), Durgapur, India, (2016). DOI: 10.1109/MicroCom.2016.7522560
31. [31] Roy, K. S. and Islam, S. M. R., "An RNN-based Hybrid Model for Classification of Electrooculogram Signal for HCI", International Journal of Computing, 22, (3): 335-344, (2023). DOI: 10.47839/ijc.22.3.3228
32. [32] Saravanakumar, D., Vishnupriya, R., and Reddy, M. R., "A novel EOG based synchronous and asynchronous visual keyboard system," Proceedings of the 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Chicago, IL, USA, (2019). DOI: 10.1109/BHI.2019.8834621
33. [33] Teja, S. S. S., Embrandiri, S. S., Chandrachoodan, N., and Reddy, R., "EOG based virtual keyboard," Proceedings of the 2015 41st Annual Northeast Biomedical Engineering Conference (NEBEC), Troy, NY, USA, (2015). DOI: 10.1109/NEBEC.2015.7117201
34. [34] Ülkütaş, H. Ö. and Yıldız, M., "Computer based eye-writing system by using EOG," Proceedings of the 2015 Medical Technologies National Conference (TIPTEKNO), Bodrum, Turkey, (2015). DOI: 10.1109/TIPTEKNO.2015.7374580
35. [35] Zou, J. and Zhang, Q., "eyeSay: Make eyes speak for ALS patients with deep transfer learning-empowered wearable," Proceedings of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Mexico, (2021). DOI: 10.1109/EMBC46164.2021.9629874
36. [36] Ding, Y., Tang, P., Li, J., Zeng, C., Sun, Y., Zhang, Y., and Liu, W., "Study for Electrooculography Character Input Based on Dual-channel CNN of Movement Disorder Patients", IEEE Access, (2024). DOI: 10.1109/ACCESS.2024.3432130
37. [37] Preetha, S. and Sasikala, M., "A real-time ML-based asynchronous HCI speller system using EOG signals", Biomedical Signal Processing and Control, 104: 107463, (2025). DOI: 10.1016/j.bspc.2024.107463
38. [38] Tsai, J., Lee, C., Wu, C., Wu, J., and Kao, K., "A feasibility study of an eye-writing system based on electro-oculography", Journal of Medical and Biological Engineering, 28, (1): 39, (2008).
39. [39] Choi, H.-T., Mi, E. A. B. E., Kim, B.-K., and Chang, W.-D., "Electrooculography signal generation with conditional diffusion models for eye movement classification", Biomedical Signal Processing and Control, 110: 108211, (2025). DOI: 10.1016/j.bspc.2025.108211
40. [40] Madariaga, S., Babul, C., Egana J. I., Rubio-Venegas, I., Güney, G., Concha-Miranda, M., Maldonado, P., and Devia, C., "SaFiDe: Detection of saccade and fixation periods based on eye-movement attributes from video-oculography, scleral coil or electrooculography data", MethodsX, 10: 102041, (2023). DOI: 10.1016/j.mex.2023.102041
41. [41] Sime, M. M., Bissoli, A. L. C., Lavino-Júnior, D., and Bastos-Filho, T. F., "Usability, occupational performance and satisfaction evaluation of a smart environment controlled by infrared oculography by people with severe motor disabilities", Plos one, 16, (8): e0256062, (2021). DOI: 10.1371/journal.pone.0256062
42. [42] Tepe, C. and Savaştaer, E. F., "A computer‐aided educational device and toolbox for biomedical signal processing at the undergraduate level", Computer Applications in Engineering Education, 30, (6): 1725-1738, (2022). DOI: 10.1002/cae.22552
43. [43] Güven, M., "Biyopotansiyeller ve ölçüm cihazları", Arşiv Kaynak Tarama Dergisi, 21, (3): 174-188, (2012).
44. [44] Dhuliawala, M., Lee, J., Shimizu, J., Bulling, A., Kunze, K., Starner, T., and Woo, W., "Smooth eye movement interaction using EOG glasses," Proceedings of the Proceedings of the 18th ACM International Conference on Multimodal Interaction, (2016). DOI: 10.1145/2993148.2993181
45. [45] Uema, Y. and Inoue, K., "JINS MEME algorithm for estimation and tracking of concentration of users," Proceedings of the Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, (2017). DOI: 10.1145/3123024.3123189
46. [46] Diaz Romera, D., Yee, N., Daum, C., Stroulia, E., and Liu, L., "Activity classification in independent living environment with JINS MEME Eyewear," Proceedings of the Conférence présentée aPerCOM, Athens, Greece, (2018). DOI: 10.1109/PERCOM.2018.8444580
47. [47] g.tech. "g.USBamp RESEARCH: Unleash Remarkable Precision in Physiological Data Acquisition " https://www.gtec.at/product/g-usbamp-research-unleash-remarkable-precision-in-physiological-data-acquisition/?srsltid=AfmBOorvrSscFMhznUeKHP4dRoadN1WOllT6wfhJ4AiFuxSiQbiwmPNF (accessed 23.11.2024.
48. [48] Biosemi. https://www.biosemi.com/Products_ActiveTwo.htm (accessed 23.11.2024).
49. [49] Inc., B. S. "EOG100C." https://www.biopac.com/product/electrooculogram-amplifier/ (accessed 23.11.2024).
50. [50] Neuroscan, C. "NuAmps." https://compumedicsneuroscan.com/nuamps-2/ (accessed 23.11.2024).
51. [51] Systems, C. R. "BlueGain EOG Biosignal Amplifier." https://www.crsltd.com/tools-for-vision-science/eye-tracking/bluegain-eog-biosignal-amplifier/ (accessed 23.11.2024).
52. [52] Instruments, T. "ADS1299." https://www.ti.com/lit/ds/symlink/ads1299.pdf?ts=1739193221424&ref_url=https%253A%252F%252Fwww.google.com%252F (accessed 23.11.2024).
53. [53] Majaranta, P. and Räihä, K.-J., "Twenty years of eye typing: systems and design issues," Proceedings of the Proceedings of the 2002 symposium on Eye tracking research & applications, (2002). DOI: 10.1145/507072.507076
54. [54] Gajendiran, S. and Sivagnanam, Y., "Acquisition and Detection of Eye Movement Using Electrooculography," Proceedings of the 2024 International Conference on Signal Processing and Advance Research in Computing (SPARC), (2024). DOI: 10.1109/SPARC61891.2024.10829113
55. [55] Kim, H., Kim, C., Kim, C., Kwak, H., and Im, C.-H., "New user authentication method based on eye-writing patterns identified from electrooculography for virtual reality applications", Biomedical Engineering Letters, 15, (1): 95-104, (2025). DOI: 10.1007/s13534-024-00426-8
56. [56] Kosnacova, Horvath, D., Stremy, M., Sobota, M., Bartos, P., Jagelka, M., Zavodnik, T., Vitazkova, D., Foltan, E., and Vrcek, N., Neven"Pilot experiments and hardware design of smart electrooculographic headband for people with muscular paralysis", IEEE Access, (2024). DOI: 10.1109/ACCESS.2024.3379140
57. [57] Barbara, N., Camilleri, T. A., and Camilleri, K. P., "A comparison of EOG baseline drift mitigation techniques", Biomedical Signal Processing and Control, 57: 101738, (2020). DOI: 10.1016/j.bspc.2019.101738
58. [58] Chen, Y. and Newman, W. S., "A human-robot interface based on electrooculography," Proceedings of the IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA'04. 2004, New Orleans, LA, USA, (2004). DOI: 10.1109/ROBOT.2004.1307158
59. [59] Yagi, T., "Eye-gaze interfaces using electro-oculography (EOG)," Proceedings of the Proceedings of the 2010 workshop on Eye gaze in intelligent human machine interaction, (2010). DOI: 10.1145/2002333.2002338
60. [60] Yagi, T., Kuno, Y., Koga, K., and Mukai, T., "Drifting and blinking compensation in electro-oculography (EOG) eye-gaze interface," Proceedings of the 2006 IEEE International Conference on Systems, Man and Cybernetics, Taipei, Taiwan, (2006). DOI: 10.1109/ICSMC.2006.384613
61. [61] Iáñez, E., Azorin, J. M., and Perez-Vidal, C., "Using eye movement to control a computer: A design for a lightweight electro-oculogram electrode array and computer interface", PloS one, 8, (7): e67099, (2013). DOI: 10.1371/journal.pone.0067099
62. [62] Chieh, T. C., Mustafa, M. M., Hussain, A., Hendi, S. F., and Majlis, B. Y., "Development of vehicle driver drowsiness detection system using electrooculogram (EOG)," Proceedings of the 2005 1st International Conference on Computers, Communications, & Signal Processing with Special Track on Biomedical Engineering, Kuala Lumpur, Malaysia, (2005). DOI: 10.1109/CCSP.2005.4977181
63. [63] Paul, G. M., Cao, F., Torah, R., Yang, K., Beeby, S., and Tudor, J., "A smart textile based facial EMG and EOG computer interface", IEEE sensors journal, 14, (2): 393-400, (2013). DOI: 10.1109/JSEN.2013.2283424
64. [64] Barea, R., Boquete, L., Rodriguez-Ascariz, J. M., Ortega, S., and López, E., "Sensory system for implementing a human—computer interface based on electrooculography", Sensors, 11, (1): 310-328, (2010). DOI: 10.3390/s110100310
65. [65] Duvinage, M., Castermans, T., and Dutoit, T., "Control of a lower limb active prosthesis with eye movement sequences," Proceedings of the 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB), Paris, France, (2011). DOI: 10.1109/CCMB.2011.5952116
66. [66] López, A., Rodriguez, I., Ferrero, F., Valledor, M., and Campo, J., "Low-cost system based on electro-oculography for communication of disabled people," Proceedings of the 2014 IEEE 11th International Multi-Conference on Systems, Signals & Devices (SSD14), Barcelona, Spain, (2014). DOI: 10.1109/SSD.2014.6808755
67. [67] Ma, J., Zhang, Y., Cichocki, A., and Matsuno, F., "A novel EOG/EEG hybrid human–machine interface adopting eye movements and ERPs: Application to robot control", IEEE transactions on biomedical engineering, 62, (3): 876-889, (2014). DOI: 10.1109/TBME.2014.2369483
68. [68] English, E., Hung, A., Kesten, E., Latulipe, D., and Jin, Z., "EyePhone: A mobile EOG-based human-computer interface for assistive healthcare," Proceedings of the 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER), San Diego, CA, USA, (2013). DOI: 10.1109/NER.2013.6695882
69. [69] Zargari Marandi, R. and Sabzpoushan, S. H., "Qualitative modeling of the decision-making process using electrooculography", Behavior research methods, 47: 1404-1412, (2015). DOI: 10.3758/s13428-014-0549-9
70. [70] Von Borries, R., Pierluissi, J., and Nazeran, H., "Wavelet transform-based ECG baseline drift removal for body surface potential mapping," Proceedings of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, Shanghai, China, (2006). DOI: 10.1109/IEMBS.2005.1615311
71. [71] Zhang, D., "Wavelet approach for ECG baseline wander correction and noise reduction," Proceedings of the 2005 IEEE engineering in medicine and biology 27th annual conference, Shanghai, (2006). DOI: 10.1109/IEMBS.2005.1616642
72. [72] Favre-Félix, A., Graversen, C., Dau, T., and Lunner, T., "Real-time estimation of eye gaze by in-ear electrodes," Proceedings of the 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Jeju, Korea (South), (2017). DOI: 10.1109/EMBC.2017.8037754
73. [73] Hossain, M. S., Huda, K., and Ahmad, M., "Command the computer with your eye-An electrooculography based approach," Proceedings of the The 8th International Conference on Software, Knowledge, Information Management and Applications (SKIMA 2014), Dhaka, Bangladesh, (2014). DOI: 10.1109/SKIMA.2014.7083534
74. [74] Huda, K., Hossain, M. S., and Ahmad, M., "Recognition of reading activity from the saccadic samples of electrooculography data," Proceedings of the 2015 International Conference on Electrical & Electronic Engineering (ICEEE), Rajshahi, Bangladesh, (2015). DOI: 10.1109/CEEE.2015.7428296
75. [75] Pettersson, K., Jagadeesan, S., Lukander, K., Henelius, A., Hæggström, E., and Müller, K., "Algorithm for automatic analysis of electro-oculographic data", Biomedical engineering online, 12: 1-18, (2013). DOI: 10.1186/1475-925X-12-110
76. [76] Banerjee, A., Pal, M., Datta, S., Tibarewala, D., and Konar, A., "Eye movement sequence analysis using electrooculogram to assist autistic children", Biomedical Signal Processing and Control, 14: 134-140, (2014). DOI: 10.1016/j.bspc.2014.07.010
77. [77] Aungsakul, S., Phinyomark, A., Phukpattaranont, P., and Limsakul, C., "Evaluating feature extraction methods of electrooculography (EOG) signal for human-computer interface", Procedia Engineering, 32: 246-252, (2012). DOI: 10.1016/j.proeng.2012.01.1264
78. [78] Duraisamy, S. and Reddy, R., "Stimulus Paradigm for an Asynchronous Concurrent SSVEP and EOG Based BCI Speller System", IEEE Access, 9: 127484-127495, (2021). DOI: 10.1109/ACCESS.2021.3112257
79. [79] Rusydi, M. I., Anandika, A., Adnan, R., Matsuhita, K., and Sasaki, M., "Adaptive Symmetrical Virtual Keyboard Based on EOG Signal," Proceedings of the 2019 4th Asia-Pacific Conference on Intelligent Robot Systems (ACIRS), Nagoya, Japan, (2019). DOI: 10.1109/ACIRS.2019.8935956
80. [80] Wu, C.-M., Chuang, C. Y., Hsieh, M.-C., and Chang, S.-H., "An eye input device for persons with the motor neuron diseases", Biomedical Engineering: Applications, Basis and Communications, 25, (01): 1350006, (2013). DOI: 10.4015/S1016237213500063