Research Article

Comparison of VR and Desktop Game User Experience in a Puzzle Game: “Keep Talking and Nobody Explodes”

Volume: 11 Number: 42 October 17, 2020
TR EN

Comparison of VR and Desktop Game User Experience in a Puzzle Game: “Keep Talking and Nobody Explodes”

Abstract

Since the contemporary game production process is based on the Integrated Development Environment (IDE) applications, it is easier for developers to create multiple versions of their game for both VR and desktop platforms. This provided a great opportunity for researchers to conduct comparative studies to explore the user experience of the relatively novel virtual reality applications In this study, we evaluated a puzzle game through a within-subjects experiment design using objective measures of game success and gameplay duration, as well as plenty of subjective measures in order to assess game user experience, comparing desktop and VR. In addition to selected dimensions of GUESS (Game User Experience Satisfaction Scale), we employed MEC-SPQ (Measurement Effects Conditions - Spatial Presence Questionnaire) to measure presence. Furthermore, we employed NASA-TLX (NASA Task Load Index) to compare the perceived task complexity of the same task executed in VR and desktop gaming environments. Results revealed that there is not a significant difference in objective measures of player performance, comparing the VR and desktop gameplay. The Game User Experience Satisfaction Scale did not reveal any significant difference between the mean scores of VR and desktop experiences. The spatial presence related dimensions of MEC-SPQ revealed significantly higher scores of VR, for Possible Actions and Self Location dimensions. NASA-TLX weighted scores were significantly higher for VR in physical load and for desktop in frustration. Our results show that a puzzle-based game experienced in VR does not lead to a higher level of satisfaction in terms of game user experience but triggers a sense of spatial presence. Due to the different control schemes, players perceive that HMD based gameplay demands more physical task load. However, the gameplay duration and game success rate are not significantly different. The failure in desktop gameplay might have led to higher frustration, since the experience seems more familiar to players. Since the results are partially concordant with previous studies, it is not possible to make a strict conclusion on the effect caused by different immersive technologies on game user experience. Further studies are required through a more consistent methodology with a focus on game design components rather than game genre.

Keywords

References

  1. Abeele, V. Vanden, Spiel, K., Nacke, L., Johnson, D., & Gerling, K. (2020). Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of Human Computer Studies. https://doi.org/10.1016/j.ijhcs.2019.102370
  2. Aksayim, A., & Berkman, M. İ. (2020). Effect of Physical Activity on VR Experience: An Experimental Study. In S. Richir (Ed.), Laval Virtual ConVRgence (VRIC) Virtual Reality International Conference - VRIC 2020. Retrieved from https://ijvr.eu/article/view/3316
  3. Anton, D., Kurillo, G., & Bajcsy, R. (2018). User experience and interaction performance in 2D/3D telecollaboration. Future Generation Computer Systems. https://doi.org/10.1016/j.future.2017.12.055
  4. Aoki, H., Oman, C. M., Buckland, D. A., & Natapoff, A. (2008). Desktop-VR system for preflight 3D navigation training. Acta Astronautica. https://doi.org/10.1016/j.actaastro.2007.11.001
  5. Arns, L., Cook, D., & Cruz-Neira, C. (1999). Benefits of statistical visualization in an immersive environment. Proceedings - Virtual Reality Annual International Symposium.
  6. Bacim, F., Ragan, E., Scerbo, S., Polys, N. F., Setareh, M., & Jones, B. D. (2013). The effects of display fidelity, visual complexity, and task scope on spatial understanding of 3D graphs. Proceedings - Graphics Interface.
  7. Berkman, M. İ., Bostan, B., & Yalçın, B. (2020). Controllers in VR Game User Experience: Perceived User Performance on a VR Puzzle Game. In Contemporary Topics in Computer Graphics and Games: Selected Papers from the Eurasia Graphics Conference Series.
  8. Berkman, M. I., & Akan, E. (2019). Presence and Immersion in Virtual Reality. In Encyclopedia of Computer Graphics and Games (pp. 1–10). https://doi.org/10.1007/978-3-319-08234-9_162-1

Details

Primary Language

English

Subjects

-

Journal Section

Research Article

Publication Date

October 17, 2020

Submission Date

May 25, 2020

Acceptance Date

October 26, 2020

Published in Issue

Year 2020 Volume: 11 Number: 42

APA
Berkman, M., Çatak, G., & Eremektar, M. (2020). Comparison of VR and Desktop Game User Experience in a Puzzle Game: “Keep Talking and Nobody Explodes”. AJIT-E: Academic Journal of Information Technology, 11(42), 180-204. https://doi.org/10.5824/ajite.2020.03.008.x
AMA
1.Berkman M, Çatak G, Eremektar M. Comparison of VR and Desktop Game User Experience in a Puzzle Game: “Keep Talking and Nobody Explodes.” AJIT-e: Academic Journal of Information Technology. 2020;11(42):180-204. doi:10.5824/ajite.2020.03.008.x
Chicago
Berkman, Mehmet, Güven Çatak, and Mıstık Eremektar. 2020. “Comparison of VR and Desktop Game User Experience in a Puzzle Game: ‘Keep Talking and Nobody Explodes’”. AJIT-E: Academic Journal of Information Technology 11 (42): 180-204. https://doi.org/10.5824/ajite.2020.03.008.x.
EndNote
Berkman M, Çatak G, Eremektar M (October 1, 2020) Comparison of VR and Desktop Game User Experience in a Puzzle Game: “Keep Talking and Nobody Explodes”. AJIT-e: Academic Journal of Information Technology 11 42 180–204.
IEEE
[1]M. Berkman, G. Çatak, and M. Eremektar, “Comparison of VR and Desktop Game User Experience in a Puzzle Game: ‘Keep Talking and Nobody Explodes’”, AJIT-e: Academic Journal of Information Technology, vol. 11, no. 42, pp. 180–204, Oct. 2020, doi: 10.5824/ajite.2020.03.008.x.
ISNAD
Berkman, Mehmet - Çatak, Güven - Eremektar, Mıstık. “Comparison of VR and Desktop Game User Experience in a Puzzle Game: ‘Keep Talking and Nobody Explodes’”. AJIT-e: Academic Journal of Information Technology 11/42 (October 1, 2020): 180-204. https://doi.org/10.5824/ajite.2020.03.008.x.
JAMA
1.Berkman M, Çatak G, Eremektar M. Comparison of VR and Desktop Game User Experience in a Puzzle Game: “Keep Talking and Nobody Explodes”. AJIT-e: Academic Journal of Information Technology. 2020;11:180–204.
MLA
Berkman, Mehmet, et al. “Comparison of VR and Desktop Game User Experience in a Puzzle Game: ‘Keep Talking and Nobody Explodes’”. AJIT-E: Academic Journal of Information Technology, vol. 11, no. 42, Oct. 2020, pp. 180-04, doi:10.5824/ajite.2020.03.008.x.
Vancouver
1.Mehmet Berkman, Güven Çatak, Mıstık Eremektar. Comparison of VR and Desktop Game User Experience in a Puzzle Game: “Keep Talking and Nobody Explodes”. AJIT-e: Academic Journal of Information Technology. 2020 Oct. 1;11(42):180-204. doi:10.5824/ajite.2020.03.008.x