A USABILITY RESEARCH ON TASK PREDICTION FOR EXPERIENCED USERS WITH COGTOOL

Abstract

Rapidly developing technology has offered different alternatives to human beings and the main target of those alternatives has been to respond to human needs. In this process, use of technology has become widespread, but it has brought some problems due to individual differences, digital competencies and generational differences. Conducting an effective process in solving those problems has also increased importance of "Human - Computer Interaction" workspace. It’s not possible to evaluate users as uniform in technology human scope. Undoubtedly, in human computer interaction, user is often assumed to be "human." Cognitive modeling practices have started to be associated with many fields, from fields of psychology, engineering sciences and economics. Over 80% of articles in major theoretical journals of Cognitive Science include cognitive modeling. This research provided by 10 participants, 4 male and 6 female users who actively use Garanti BBVA Bank mobile application. Accordingly, problem of research is to prediction on whether CogTool tool makes a true accurate prediction by participants performing tasks in line with some tasks. KLM, GOMS and other cognitive models are similar to an efficient mean to exclude the application of this process was investigated. According to research results; average time of participants to perform Task 1- 5.54 sec the lowest 4.14 sec and the highest 6.69 sec, average time for Task 2- 8.67 sec the lowest 7.59 sec and the highest 9.45 sec and Task 3- 11.60 sec was in the lowest 10.62 sec and the highest in 13.21 sec. Respectively, CogTool estimates for tasks performed were 6.1 secs for Task 1, 9.9 secs for Task 2 and 12.1 secs for Task 3. Accordingly, difference between real-time experience and CogTool predictions was measured as 0.56 sec in Task 1, 1.23 sec in Task 2 and 0.50 sec in Task 3. In the light of those findings, it’s seen CogTool tool predicts real-time results with a minor rate of error compared to average time in assigned tasks.

Keywords

• CogTool,Usability,Cognitive Modeling,Experienced User

References

1. Shneiderman, B. (1980). Software psychology: human factors in computer and information systems. Cambridge, Mass: Winthrop Publishers.
2. Weinberg, G. M. (1998). The psychology of computer programming (Silver anniversary ed). New York: Dorset House Pub.
3. Çağıltay, K. (2018). Teoriden Pratiğe İnsan – Bilgisayar Etkileşimi ve Kullanılabilirlik Mühendisliği (2. bs). İstanbul: Seçkin Yayıncılık.
4. Acartürk, C., & Çağıltay, K. (2006). İnsan bilgisayar etkileşimi ve ODTÜ'de yürütülen çalışmalar. Akademik Bilişim, 6, 9-11.
5. Çağıltay, K. (1995). Herkes için internet. Ankara: ODTÜ.
6. Dix, A., Finlay, J., Abowd, G. D., & Beale, R. (2004). Human-computer interaction (3rd ed). Harlow, England ; New York: Pearson/Prentice-Hall.
7. Dillon, R. F. (1983). Human factors in user-computer interaction: An introduction. Behavior Research Methods & Instrumentation, 15(2), 195-199. https://doi.org/10.3758/BF03203548
8. Dreyer, J. (1981). The Penguin dictionary of psychology. Harmondsworth: Penguin Books.

9. Boring, R. L. (2002). Human-Computer Interaction as Cognitive Science. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 46(21), 1767-1771. https://doi.org/10.1177/154193120204602103
10. Ertürk, E. M. (2017). Bilimsel psikolojinin tarihsel süreci üzerine. Trakya Üniversitesi Edebiyat Fakültesi Dergisi, 7(14), 161-180.
11. Meister, D. (1999). The history of human factors and ergonomics. Mahwah, N.J: Lawrence Erlbaum Associates.
12. Hollan, J., Hutchins, E., & Kirsh, D. (2000). Distributed cognition: toward a new foundation for human-computer interaction research. ACM Transactions on Computer-Human Interaction, 7(2), 174-196. https://doi.org/10.1145/353485.353487
13. Myers, B. A. (1998). A brief history of human-computer interaction technology. interactions, 5(2), 44-54. https://doi.org/10.1145/274430.274436
14. Card, S. K., Moran, T. P., & Newell, A. (1983). The psychology of human-computer interaction (Reprinted). Boca Raton, Fla. London New York: CRC Press.
15. Busemeyer, J. R., & Diederich, A. (2010). Cognitive modeling. Los Angeles: Sage Publishing.
16. Olson, J. R., & Olson, G. M. (1990). The Growth of Cognitive Modeling in Human-Computer Interaction Since GOMS. Human-computer interaction, 5, 221-265.
17. Gray, W. D., John, B. E., & Atwood, M. E. (1993). Project Ernestine: Validating a GOMS analysis for predicting and explaining real-world task performance. Human-computer interaction, 8(3), 237–309.
18. Cox, A. L., & Peebles, D. (2008). Cognitive modelling in HCI research. Cambridge University Press.
19. John, B. E. (1995). Why GOMS? interactions, 2(4), 80–89 https://doi.org/10.1145/225362.225374
20. Peebles, D., & Banks, A. (2010). Modelling dynamic decision making with the ACT-R cognitive architecture. Journal of Artificial General Intelligence, 2(2), 52-68.
21. Held, T., & Schrepp, M. (2011). Effective cognitive modeling for business software – Where and how can cognitive models support usability professionals in their everyday work? Proceedings of Usability Professionals Association International Conference Book, 1-12.
22. John, B. E. (2005). Cognitive Human Performance Modeling by Demonstration. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49, 1153–1156. SAGE Publications Sage CA: Los Angeles, CA.
23. John, B. E., & Suzuki, S. (2009). Toward cognitive modeling for predicting usability. International Conference on Human-Computer Interaction, 267–276. Springer.
24. Luo, L., & John, B. E. (2005). Predicting task execution time on handheld devices using the keystroke-level model. CHI’05 extended abstracts on Human factors in computing systems, 1605–1608. ACM.
25. Ocak, N., & Cagiltay, K. (2017). Comparison of cognitive modeling and user performance analysis for touch screen mobile interface design. International Journal of Human–Computer Interaction, 33(8), 633–641.
26. Swearngin, A., Cohen, M. B., John, B. E., & Bellamy, R. K. (2013). Human performance regression testing. Proceedings of the 2013 International Conference on Software Engineering, 152–161. IEEE Press.
27. Jorritsma, W., Haga, P.-J., Cnossen, F., Dierckx, R. A., Oudkerk, M., & van Ooijen, P. M. (2015). Predicting human performance differences on multiple interface alternatives: KLM, GOMS and CogTool are unreliable. Procedia Manufacturing, 3, 3725–3731.
28. Lee, J., & Billman, D. (2011). Modeling performance differences across systems, tasks, and strategies. Proceedings of the Annual Meeting of the Cognitive Science Society, 33.
29. Salvucci, D. D., & Lee, F. J. (2003). Simple cognitive modeling in a complex cognitive architecture. Proceedings of the SIGCHI conference on Human factors in computing systems, 265–272. ACM.