Review of the Use of Electroencephalography in User Experience Evaluation Research

Year 2022, , 83 - 95, 31.01.2022

Elif Bilge Şahin , Cem Çeliktaş , Pınar Onay Durdu

https://doi.org/10.17671/gazibtd.842888

Abstract

Nowadays, there is a growing interest in User Experience (UX) evaluation in Human-Computer Interaction (HCI) field to evaluate information systems. Meanwhile, the application of neuroscientific measurement tools in user experience studies is constantly increasing. Within the scope of this study, a systematic mapping is conducted on the use of electroencephalography (EEG), one of the neuroscientific measurement tools, in UX evaluation studies published between 2010-2020. 89 studies are gathered from Web of Science (WoS) database, Science Direct (Elsevier), IEEE Xplore Library, ACM Digital Library, according to the scope of the study, are examined. The aim of this study is to reveal the trends and the use of EEG with the other UX evaluation methods in UX evaluation research. According to the results of the study, the types of data collected by EEG for UX evaluation are emotion and attention, data is generally collected as single episodic experience. In addition, the support vector machine is used for the classification and event-related potential is used for the feature extraction of the EEG data.

Keywords

User Experience, User Experience Evaluation, EEG, Emotion, Attention

Kullanıcı Deneyimi Değerlendirme Araştırmalarında Elektroensefalografi Kullanımının İncelenmesi

Abstract

Günümüzde, bilgi sistemlerini değerlendirmek için İnsan-Bilgisayar Etkileşimi (İBE) alanında Kullanıcı Deneyimi (KD) değerlendirmesine artan bir ilgi vardır. Aynı zamanda, nörobilimsel ölçüm araçlarının KD çalışmalarında kullanımı sürekli artmaktadır. Bu çalışma kapsamında, 2010-2020 yılları arasında yayınlanan KD değerlendirme çalışmalarında nörobilimsel ölçüm araçlarından biri olan elektroensefalografi (EEG) kullanımına ilişkin sistematik bir haritalama yapılmıştır. Web of Science (WoS) veritabanı, Science Direct (Elsevier), IEEE Xplore Kütüphanesi, ACM Dijital Kütüphanesi'nden çalışma kapsamına uygun olarak belirlenip erişilebilen 89 çalışma incelenmiştir. İnceleme sonucunda bu çalışmalardaki genel eğilimlerin belirlenmesi ve KD değerlendirmesinde EEG kullanımının diğer KD değerlendirme yöntemleri ile beraber kullanımının mevcut durumunun ortaya çıkarılması hedeflenmektedir. Çalışma sonuçlarına göre KD değerlendirmesi için EEG ile toplanan veri türlerinin genellikle duygu ve dikkat olduğu, en yaygın olarak verilerin kullanım sırasında tek seferlik toplandığı tespit edilmiştir. EEG verilerinin analizine yönelik olarak yaygın kullanılan öznitelik çıkarma yönteminin destek vektör makinesi ve en sık kullanılan sınıflandırma yönteminin de olaya ilişkin potansiyel olduğu tespit edilmiştir.

Keywords

Kullanıcı Deneyimi, Kullanıcı Deneyimi Değerlendirmesi, EEG, Duygu, Dikkat

References

• M. Hassenzahl, N. Tractinsky, “User experience-A research agenda”, Behaviour & Information Technology, 25(2), 91–97, 2006.
• J. A. Bargas-Avila, K. Hornbæk, “Old wine in new bottles or novel challenges: A critical analysis of empirical studies of user experience”, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2689–2698, 2011.
• A. P. Vermeeren, E. L. C. Law, V. Roto, M. Obrist, J. Hoonhout, K. Väänänen-Vainio-Mattila, “User experience evaluation methods: Current state and development needs”, Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, 521–530, 2010.
• S. Kujala, V. Roto, K. Väänänen-Vainio-Mattila, E. Karapanos, A. Sinnelä, “UX Curve: A method for evaluating long-term user experience”, Interacting with Computers, 23(5), 473–483, 2011.
• C. L. B. Maia, E. S. Furtado, “A systematic review about user experience evaluation”, International Conference of Design, User Experience, and Usability, 445–455, 2016.
• W. Albert, T. Tullis, Measuring the user experience: Collecting, analyzing, and presenting usability metrics, Newnes, 2013.
• L. Rivero, T. Conte, “A systematic mapping study on research contributions on UX evaluation technologies”, Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems, 1–10, 2017.
• J. Frey, M. Daniel, J. Daniel, M. Daniel, F. Daniel, "Framework for Electroencephalography-based Evaluation of User Experience", ASSOC COMPUTING MACHINERY,2016.
• J. M. Kivikangas, G. Chanel, B. Cowley, I. Ekman, M. Salminen, S. Järvelä, N. Ravaja, “A review of the use of psychophysiological methods in game research”, Journal of Gaming & Virtual Worlds, 3(3), 181–199, 2011.
• J. Hassenzahl, M. Burmester, F. Koller, “AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität”, Mensch & Computer 2003 ,187–196, 2003.
• J. Bargas-Avila, K. Hornbæk, “Foci and blind spots in user experience research”, Interactions, 19(6), 24–27, 2012.
• M. Holman, F. Holman, "Taking the Subjectivity out of UX Evaluation with Emotiv EPOC+", Proceedings of the South African Institute of Computer Scientists and Information Technologists, 1-10, 2019.
• M. Van Camp, M. De Boeck, S. De Boeck, G. De Boeck, "EEG Technology for UX Evaluation: A Multisensory Perspective", ADVANCES IN NEUROERGONOMICS AND COGNITIVE ENGINEERING, 337-343, 2019.
• J. Frey, C. Mühl, F. Lotte, M. Hachet, “Review of the use of electroencephalography as an evaluation method for human-computer interaction”, In Proc. Physiological Computing Systems, 2014.
• M. S. Alharbi, User Experience Dimensions, Aspects and Measures: Systematic Literature, PhD Thesis, Prince Sultan University, 2016.
• E. L. C. Law, V. Roto, M. Hassenzahl, A. P. Vermeeren, J. Kort, “Understanding, scoping and defining user experience: A survey approach”, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 719–728, 2009.
• Scapin, D. L., Senach, B., Trousse, B., & Pallot, M, “User experience: Buzzword or new paradigm?”, Proceedings ACHI 2012, The Fifth International Conference on Advances in Computer-Human Interactions, Valencia, Spain, January 2012.
• D. Norman, J. Miller, A. Henderson, “What you see, some of what’s in the future, and how we go about doing it: HI at Apple Computer”, Conference Companion on Human Factors in Computing Systems, 155, 1995.
• Internet: International Organization for Standardization (ISO), Ergonomics of Human-System Interaction- Part 210: Human Centred Design for Interactive Systems, https://www.iso.org/standard/77520.html, 2019.
• M. Hassenzahl, “User experience (UX): Towards an experiential perspective on product quality”, Proceedings of the 20th International Conference of the Association Francophone d’Interaction Homme-Machine on - IHM ’08, 11,2008.
• K. Schulze, H. Schulze, “A framework to measure user experience of interactive online products”, Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research, 1–5, 2010.
• E. L. C. Law, “The measurability and predictability of user experience”, Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, 1–10, 2011.
• V. Roto, H. Rantavuo, K. Väänänen-Vainio-Mattila, “Evaluating user experience of early product concepts”, Proceedings of International Conference on Designing Pleasurable Products and Interfaces, 9, 199–208, 2009.
• S. Rajeshkumar, R. Omar, M. Mahmud, “Taxonomies of user experience (UX) evaluation methods”, 2013 International Conference on Research and Innovation in Information Systems, 533–538, 2013.
• N. Bevan, “What is the difference between the purpose of usability and user experience evaluation methods”, Proceedings of the Workshop UXEM, 9, 1–4, 2009.
• J. Hartmann, A. De Angeli, A. Sutcliffe, “Framing the user experience: Information biases on website quality judgement”, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 855–864, 2008.
• J. Nielsen, Usability engineering, Morgan Kaufmann, 1994.
• P. Desmet, “Measuring emotion: Development and application of an instrument to measure emotional responses to products”, Funology, 111–123, 2003.
• R. W. Picard, Affective computing, MIT press. ,2000.
• A. C. Dirican, M. Göktürk, “Psychophysiological measures of human cognitive states applied in human computer interaction”, Procedia Computer Science, 3, 1361–1367, 2011.
• Y. Liu, O. Sourina, M. K. Nguyen, “Real-time EEG-based human emotion recognition and visualization”, 2010 International Conference on Cyberworlds, 262–269, 2010.
• T. B. Alakuş, İ. Türkoğlu, “Pozitif ve Negatif Duyguların Ayrımında Etkili EEG Kanallarının Dalgacık Dönüşümü ve Destek Vektör Makineleri ile Belirlenmesi”, Bilişim Teknolojileri Dergisi, 12(3), 229-237, 2019.
• B. A. Kitchenham, O. P. Brereton, D. Budgen, M. Turner, J. Bailey, S Linkman, “Systematic literature reviews in software engineering–a systematic literature review”, Information and Software Technology, 51(1), 7–15, 2009.
• B. A. Kitchenham, T. Dyba, M. Jorgensen, “Evidence-based software engineering”, Proceedings of the 26th International Conference on Software Engineering, 273–281,2004.
• K. Petersen, S. Petersen, L. Kuzniarz, “Guidelines for conducting systematic mapping studies in software engineering: An update”, Information and Software Technology, 64, 1–18, 2005.
• S. Balters, M. Steinert, “Capturing emotion reactivity through physiology measurement as a foundation for affective engineering in engineering design science and engineering practices”, Journal of Intelligent Manufacturing, 28(7), 1585–1607, 2017.
• T. B. Taffese, A Review of Using EEG and EMG Psychophysiological Measurements in User Experience Research, PhD Thesis, University of Oulu, Finland, 2017.
• I. Pettersson, F. Lachner, A.-K. Frison, A. Riener, A. Butz, “A Bermuda Triangle? A Review of Method Application and Triangulation in User Experience Evaluation”, Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 1–16, 2018.
• T. Zaki, M.N. Islam, “Neurological and physiological measures to evaluate the usability and user-experience (UX) of information systems: A systematic literature review”, Computer Science Review, 40, 100375, 2021.
• K. Petersen, R. Feldt, S. Mujtaba, M. Mattsson, “Systematic mapping studies in software engineering”, 12th International Conference on Evaluation and Assessment in Software Engineering, Bari, Italy, 68-77, 26-27 June, 2008.
• B. A. Kitchenham, D. Budgen, O.P. Brereton, “The value of mapping studies – a participant-observer case study”, In: EASE 2010 Proceedings of the 14th International Conference on Evaluation and Assessment in Software Engineering, 25–33, 2010.
• T. Çakar, K. Rızvanoğlu, Ö. Öztürk, D.Z. Çelik, İ. Gürvardar, "The Use of Neurometric and Biometric Research Methods in Understanding the User Experience During Product Search of First-Time Buyers in E-Commerce", Springer International Publishing, 342-362, 2017.
• Kelekçi, Eeg cihazı ile kullanılabilirlik çalışması: Bir kitlesel açık çevrimiçi ders ortamı örneği, MIT press, 2019.
• D. Te’eni, J. Carey, P. Zhang, Human-computer interaction: Developing effective organizational information systems, John Wiley & Sons, Inc, 2007.
• J. A. Russell, “A circumplex model of affect”, Journal of Personality and Social Psychology, 39(6), 1161,1980.
• P. Ekman, “Basic emotions”, Handbook of Cognition and Emotion, 98(45–60), 16, 1999.
• A. Al-Nafjan, M. Hosny, Y. Al-Ohali, A. Al-Wabil, “Review and classification of emotion recognition based on EEG brain-computer interface system research: A systematic review”, Applied Sciences, 7(12), 1239, 2017.
• Internet: Emotiv Inc, EMOTIV EPOC+ 14-Channel Wireless EEG Headset. EMOTIV, https://www.emotiv.com/epoc/, 2021.
• Internet: Neurosky Inc, EEG - ECG - Biosensors, http://neurosky.com/ , 2021.