TY  - JOUR
T1  - A Shorter Form of the Game User Experience Satisfaction Scale in Turkish: GUESS-20-TR
TT  - Oyun Kullanıcı Deneyimi Tatmin Ölçeği Türkçe Kısa Versiyonu: GUESS-20-TR
AU  - Aker, Çakır
AU  - Berkman, Mehmet İlker
PY  - 2023
DA  - December
DO  - 10.26650/acin.1185840
JF  - Acta Infologica
JO  - ACIN
PB  - Istanbul University
WT  - DergiPark
SN  - 2602-3563
SP  - 229
EP  - 242
VL  - 7
IS  - 2
LA  - en
AB  - Games User Research (GUR) has become an important subdomain of the Human Computer Interaction field within the last few years, as gaming has becomes a daily entertainment for many people rather than being in the interest of a few game enthusiasts. Researchers require specific tools to measure the users’ responses and attitudes towards the games. Game User Experience Satisfaction Scale is one of the recent additions to GUR tools, which had already been adapted into Turkish as GUESSTR. Through this study, we aimed to verify a shorter form of GUESS-TR which is compatible with a currently existing English shorter version with 18 items that measure game user experience through 9 factors. Data revealed that a 20-item version resembling 10 factors, namely GUESS-20-TR, is a valid and reliable measure of game user experience. We provided evidence for construct validity through confirmatory factor analysis. Spearman-Brown prophecy coefficients indicate that the 2-item subscales are reliable. Heterotrait - monotrait ratios show that items indicate different constructs, i.e. discriminant validity. Based on Pearson correlation, the mean scoresobtained with the short form GUESS-20-TR are highly consistent with the 51-item Turkish version.
KW  - Games user research
KW  - games user experience
KW  - scale adaptation
N2  - Oyunların sadece tutkunlarına özel bir alan olmaktan çıkıp pek çok insan için gündelik bir eğlence haline gelmesi ile, Oyun Kullanıcı Araştırmaları (OKA), İnsan-Bilgisayar Etkileşimi alanının önemli bir alt dalı haline gelmiştir. Araştırmacılar, oyuncuların oyunlara verdikleri tepkileri ve oyunlara karşı tutumlarını ölçmek için özelleştirilmiş araçlara ihtiyaç duymaktadırlar. Oyun Kullanıcı Deneyimi Ölçeği (GUESS) de son yıllarda OKA araçlarına eklenmiş olup, GUESS-TR adı ile Türkçe’ye de çevrilmiştir. Bu çalışmada, 51 sorudan oluşan GUESS-TR’nin kısa bir versiyonu geliştirilmiştir. Halihazırda 9 faktörü ölçen 18 soruluk kısaltılmış GUESS-18 versiyonu da göz önüne alınarak, 20 sorudan oluşan ve 10 faktörü ölçen bir varyant ortaya konmuştur. Onaylayıcı faktör analizi ölçüm modelinin yapısal geçerliliğinin sağlaması yapılmıştır. İki sorudan oluşan ölçekler için önerilen Spearman-Brown korelasyon katsayısı alt ölçeklerin güvenilirliğine delalet etmektedir. Heterotrait- monotrait oranları, her bir ölçeğin farklı yapıları ölçtüğünü, yani ayrımlayıcı geçerliliği ortaya koymaktadır. Pearson korelasyon katsayıları göstermektedir ki, her bir faktör için 2 soru olmak üzere 20 soru ile elde edilen ortalama skorlar, 51 sorudan oluşan uzun ölçek ve alt ölçeklerinin ortalama skorları ile yüksek seviyede tutarlılık göstermektedir.
CR  - Abeele, V. V., Spiel, K., Nacke, L., Johnson, D., & Gerling, K. (2020). Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of Human-Computer Studies, 135, 102370. https://doi.Org/10.1016/j.yhcs.2019.102370 google scholar
CR  - Akan, E., Berkman, M.İ. (2020). Physiological Measures in Game User Research. In: Bostan, B. (eds) Game User Experience And Player-Centered Design. International Series on Computer Entertainment and Media Technology. Springer, Cham. https://doi.org/10.1007/978-3-030-37643-7_10 google scholar
CR  - Aker, Ç., Rızvanoğlu, K.,& Bostan, B. (2017). Methodological review of playability heuristics. Proc. Eurasia Graph. Istanbul. Turk, 405. google scholar
CR  - Aksayim, A., & Berkman, M. İ. (2020). Effect of physical activity on VR experience: an experimental study. In Richir, S. (Ed.) Laval Virtual ConVRgence (VRIC) Virtual Reality International Conference-VRIC, pp. 19-27. 22-24 April 2020, Laval, France. google scholar
CR  - Ali, A. S., & Arumugam, A. & Kumaran, S. (2021). Effectiveness of an intensive, functional, gamified Rehabilitation program in improving upper limb motor function in people with stroke: A protocol of the EnteRtain randomized clinical trial. Contemporary Clinical Trials, 105, 106381. https://doi.org/10.1016/j.cct.2021.106381 google scholar
CR  - Alkan S., Cagiltay K. (2007) Studying computer game learning experience through eye tracking. British Journal of Educational Technology, 38(3), pp 538-542. https://doi.Org/10.1111/j.1467-8535.2007.00721.x google scholar
CR  - Berkman, M. İ., Bostan, B., & Şenyer, S. (2022a). Turkish Adaptation Study of the Game User Experience Satisfaction Scale: GUESS-TR. International Journal of Human-Computer Interaction, 38(11), 1081-1093. https://doi.org/10.1080/10447318.2021.1987679 google scholar
CR  - Berkman, M. İ., Bostan, B., & Şenyer, S. (2022b), “Game User Experience Satisfaction Scale Applied in Turkish”, Mendeley Data, V2, https://doi.org/10.17632/pxnzgdz287.2 google scholar
CR  - Boberg, M., Karapanos, E., Holopainen, J., & Lucero, A. (2015, October). PLEXQ: Towards a playful experiences questionnaire. In Proceedings of the CHI PLAY ’15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, October 2015, pp. 381-391 https://doi.org/10.1145/2793107.2793124 google scholar
CR  - Bostan, B. (2022) Dijital Oyunlar ve İnteraktif Anlatı. Istanbul, Turkey: The Kitap, 2022. google scholar
CR  - Brooke, J. (1996). SUS: A quick and dirty usability scale. In P.W. Jordan, B. Thomas, B. A. Weerdmeester & I. L. McClelland (Eds.), Usability Evaluation in Industry (pp. 189-194). London: Taylor & Francis google scholar
CR  - Desurvire, H., & Wixon, D. (2018). Heuristics uncovered for games user researchers and game designers. In Anders Drachen, Pejman Mirza-Babaei, Lennart E. Nacke (Eds) Games User Research, 217-256. https://doi.org/10.1093/oso/9780198794844.003.0014 google scholar
CR  - Desurvire, H., Caplan, M., & Toth, J. A. (2004, April). Using heuristics to evaluate the playability of games. In CHI’04 extended abstracts on Human factors in computing systems (pp. 1509-1512). google scholar
CR  - Drachen, A., & Connor, S. (2018). Game analytics for games user research. In Anders Drachen, Pejman Mirza-Babaei, Lennart E. Nacke (Eds) Games User Research (pp. 333-353). Oxford University Press. https://doi.org/10.1093/oso/9780198794844.003.0019 google scholar
CR  - Eisinga, R., Grotenhuis, M. T., & Pelzer, B. (2013). The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown? International Journal of Public Health, 58(4), 637-642. https://doi.org/10.1007/s00038-012-0416-3 google scholar
CR  - Ermi, L., & Mâyrâ, F. (2005). Fundamental Components of the Gameplay Experience: Analysing Immersion. DiGRA conference Changing Views: Worlds in Play, Vancouver, Canada. google scholar
CR  - Federoff, M. A. (2002). Heuristics and usability guidelines for the creation and evaluation of fun in video games (Doctoral dissertation, Indiana University). google scholar
CR  - Gorsic, M., Clapp, J. D., Darzi, A., & Novak, D. (2019). A brief measure of interpersonal interaction for 2-player serious games: questionnaire validation. JMIR serious games, 7(3), e12788. https://doi.org/10.2196/12788 google scholar
CR  - Hafeez, T., Umar Saeed, S. M., Arsalan, A., Anwar, S. M., Ashraf, M. U., & Alsubhi, K. (2021). EEG in game user analysis: A framework for expertise classification during gameplay. Plos one, 16(6), e0246913. https://doi.org/10.1371/journal.pone.0246913 google scholar
CR  - Henseler, J., Ringle, C.M. & Sarstedt, M. (2015) A new criterion for assessing discriminant validity in variance-based structural equation modeling. J. of the Acad. Mark. Sci. 43, 115-135. https://doi.org/10.1007/s11747-014-0403-8 google scholar
CR  - Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural equation modelling: Guidelines for determining model fit. Electronic journal of business research methods, 6(1), pp53-60. google scholar
CR  - IJsselsteijn, W. A., De Kort, Y. A. W., & Poels, K. (2007). The Game Experience Questionnaire: Development of a self-report measure to assess the psychological impact of digital games. Manuscript in Preparation (pp. 9241-210). FUGA technical report Deliverable 3.3. google scholar
CR  - Isman, F. A., Prasasti, A. L., & Nugrahaeni, R. A. (2021, April). Expression Classification For User Experience Testing Using Convolu-tional Neural Network. In 2021 International Conference on Artificial Intelligence and Mechatronics Systems ( AIMS) (pp. 1-6). IEEE. https://doi.org/10.1109/AIMS52415.2021.9466088 google scholar
CR  - Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tjs, T., & Walton, A. (2008). Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies, 66(9), 641-661. https://doi.org/10.1016/j.jhcs.2008.04.004 google scholar
CR  - Johnson, D., Gardner, M. J., & Perry, R. (2018). Validation of two game experience scales: the player experience of need sat-isfaction (PENS) and game experience questionnaire (GEQ). International Journal of Human-Computer Studies, 118, 38-46. https://doi.org/10.1145/1152215.1152218 google scholar
CR  - Ju, U., & Wallraven, C. (2019). Manipulating and decoding subjective gaming experience during active gameplay: a multivariate, whole-brain analysis. NeuroImage, 188, 1-13. 
https://doi.org/10.1016/j.neuroimage.2018.11.061 google scholar
CR  - Keebler, J. R., Shelstad, W. J., Smith, D. C., Chaparro, B. S., & Phan, M. H. (2020). Validation of the GUESS-18: a short version of the Game User Experience Satisfaction Scale (GUESS). Journal of Usability Studies, 16(1), 49. https://uxpajournal.org/validation-game-user-experience-satisfaction-scale-guess/ google scholar
CR  - Kivikangas, J. M., Chanel, G., Cowley, B., Ekman, I., Salminen, M., Jârvelâ, S., & Ravaja, N. (2011). A review of the use of psychophysiological methods in game research. Journal of Gaming & Virtual Worlds, 3(3), 181-199. https://.doi.org/10.1386/jgvw.3.3.181_1 google scholar
CR  - Korhonen, H., & Koivisto, E. M. (2006, September). Playability heuristics for mobile games. In Proceedings of the 8th conference on Human-computer interaction with mobile devices and services (pp. 9-16). https://doi.org/10.1145/1152215.1152218 google scholar
CR  - Korhonen, H., & Koivisto, E. M. (2007, September). Playability heuristics for mobile multi-player games. In Proceedings ofthe 2nd international conference on Digital interactive media in entertainment and arts (pp. 28-35). google scholar
CR  - de Kort, Y. A., IJsselsteijn, W. A., & Poels, K. (2007). Digital games as social presence technology: Development of the Social Presence in Gaming Questionnaire (SPGQ). Proceedings of PRESENCE, 195203, 1-9. google scholar
CR  - Law, E. L. C., Brühlmann, F., & Mekler, E. D. (2018, October). Systematic review and validation of the game experience questionnaire (GEQ)-implications for citation and reporting practice. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (pp. 257-270). google scholar
CR  - Malone, T. W. (1982, March). Heuristics for designing enjoyable user interfaces: Lessons from computer games. In Proceedings of the 1982 conference on Human factors in computing systems (pp. 63-68). https://doi.org/10.1145/800049.801756 google scholar
CR  - Medlock, M.C. (2018) "An overview of GUR methods." In Anders Drachen, Pejman Mirza-Babaei, Lennart E. Nacke (Eds). Games User Research. Oxford University Press. https://doi.org/10.1093/oso/9780198794844.003.0007 google scholar
CR  - Mittmann, G., Zehetner, V., Krammer, I., & Schrank, B. (2023). Translation, adaptation and validation of the German version of the Game User Experience Satisfaction Scale (GUESS-GA-18) for adolescents. Behaviour & Information Technology, 1-15. https://doi.org/10.1080/0144929X.2023.2212807 google scholar
CR  - Mojzisch, A., Schilbach, L., Helmert, J.R., Pannasch, S., Velichkovsky, B.M., Vogeley K. (2006) The effects of self-involvement on attention, arousal, and facial expression during social interaction with virtual others: A psychophysiological study. Social Neuroscience, 1(3-4), pp 184-195. https://doi.org/10.1080/17470910600985621 google scholar
CR  - Mueller S.C., Jackson C.P., Skelton R.W. (2008) Sex differences in a virtual water maze: An eye tracking and pupillometry study. Behavioural Brain Research, 193(2), pp 209-215. https://doi.org/10.1016/j.bbr.2008.05.017 google scholar
CR  - Schaffer, N. (2008). Heuristic UX Evaluation of Games. In Isbister K., Hodent, C. (Eds) Game Usability (pp. 105-114). CRC Press. google scholar
CR  - Nguyen, N. C., Thawonmas, R., Paliyawan, P., & Pham, H. V. (2020, August). JUSTIN: An audience participation game with a purpose for collecting descriptions for artwork images. In 2020 IEEE Conference on Games (CoG) (pp. 344-350). IEEE. https://doi.org/10.1109/CoG47356.2020.9231771 google scholar
CR  - Phan, M. H., Keebler, J. R., & Chaparro, B. S. (2016). The development and validation of the Game User Experience Satisfaction Scale (GUESS). Human Factors, 58(8), 1217-1247. https://doi.org/10.1177/0018720816669646 google scholar
CR  - Qin, H., Patrick Rau, P. L., & Salvendy, G. (2009). Measuring player immersion in the Computer game narrative. Intl. Journal of Human-Computer Interaction, 25(2), 107-133. https://doi.org/10.1080/10447310802546732 google scholar
CR  - Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006). The motivational pull of video games: A self-determination theory approach. Motivation and Emotion, 30(4), 344-360. https://doi.org/10.1007/s11031-006-9051-8 google scholar
CR  - Rindskopf, D. (1984). Structural equation models: Empirical identification, Heywood cases, and related problems. Sociological Methods & Research, 13(1), 109-119. https://doi.org/10.1177/0049124184013001004 google scholar
CR  - Shelstad, W. J., Smith, D. C., & Chaparro, B. S. (2017). Gaming on the rift: How virtual reality affects game user satisfaction. Proceedings of the Human Factors and Ergonomics Society, 2017-October, 2072-2076. Texas, Austin: HFES. google scholar
CR  - Thevin, L., Rodier, N., Oriola, B., Hachet, M., Jouffrais, C.,& Brock, A. M. (2021). Inclusive adaptation of existing board games for gamers with and without visual impairments using a spatial augmented reality framework for touch detection and audio feedback. Proceedings of the ACM on Human-Computer Interaction, 5(ISS), 1-33. https://doi.org/10.1145/3488550 google scholar
CR  - Wijaya, I. G. N. T., Hansun, S., & Kristanda, M. B. (2019). DISDAIN: An auto content generation VR game. Indian Journal of Science and Technology, 12(7), 1-7. https://doi.org/10.17485/jst/2019/v12i7/141370 google scholar
CR  - Xu, J., Paliyawan, P., Thawonmas, R., & Harada, T. (2019). Player dominance adjustment: Promoting self-efficacy and experience of game players by adjusting dominant power. 2019 IEEE 8th Global Conference on Consumer Electronics, GCCE 2019, 487-488. Osaka, Japan: IEEE. https://doi.org/10.1109/GCCE46687.2019.9015408 google scholar
CR  - Yildirim, C., Carroll, M., Hufnal, D., Johnson, T., & Pericles, S. (2018, August). Video game user experience: to VR, or not to VR? In 2018 IEEE Games, Entertainment, Media Conference (GEM) (pp. 1-9). IEEE. https://doi.org/10.1109/GEM.2018.8516542 google scholar
UR  - https://doi.org/10.26650/acin.1185840
L1  - https://dergipark.org.tr/en/download/article-file/2695239
ER  -