A Turkish Translation of the System Usability Scale: The SUS-TR

Year 2018, Volume: 11 Issue: 3, 237 - 253, 30.09.2018

Denizhan Demirkol , Çağla Şeneler

Abstract

Aim of developing usable and effective systems yield need for measuring quality of user experience with a system. The System Usability Scale (SUS) questionnaire that was developed in English has been widely used in the literature for assessing perceived usability of interactive systems. This study aimed to adapt the SUS into Turkish and investigate its validity and reliability. To verify the translation, two professional translation techniques were used and four translators were employed. The official Turkish version of the SUS (SUS-TR) conducted to 324 university students. The SUS-TR’s reliability was studied and it was found at a high level. Furthermore, confirmatory factor analyses (CFA) successfully revealed the two-factor structure of the SUS-TR. The results of this study showed that the SUS-TR is a reliable and valid tool for measuring usability, with psychometric properties consistent with the original version. The SUS-TR was developed successfully to make it suitable for users from Turkey.

Keywords

System Usability Scale, Usability, Turkish, Reliability

Sistem Kullanılabilirlik Ölçeğinin Türkçeye Çevirisi: SUS-TR

Abstract

Özet

Kullanılabilir ve verimli sistemlerin geliştirmesi amacı, kullanıcının sistem deneyiminin kalitesinin ölçülme ihtiyacını açığa çıkarmaktadır. İngilizce olarak geliştirilen Sistem Kullanılabilirlik Ölçeği (SUS), interaktif sistemlerin algılanan kullanılabilirliğini değerlendirmek için literatürde yaygın olarak kullanılmıştır. Bu çalışma SUS'un Türkçeye uyarlanmasını, geçerliliğini ve güvenilirliğini araştırmayı amaçlamıştır. Çeviriyi doğrulamak için, iki profesyonel çeviri tekniği ve dört çevirmen kullanılmıştır. SUS-TR, 324 üniversite öğrencisine uygulanmıştır. SUS'un Türkçe versiyonu olan SUS-TR'ın güvenilirliği çalışılmış ve yüksek düzeyde bulunmuştur. Ayrıca, doğrulayıcı faktör analizi, SUS-TR'nin iki faktörlü yapısını başarılı bir şekilde ortaya koymuştur. Bu çalışmanın sonuçları, SUS-TR'nin kullanılabilirliği ölçmek için güvenilir ve geçerli bir araç olduğunu ve orijinal İngilizce versiyonuyla tutarlı psikometrik özellikleri olduğunu göstermiştir. Sonuç olarak, SUS-TR başarılı bir şekilde geliştirilmiş ve Türk kullanıcılara uygun hale getirilmiştir.

Keywords

Sistem Kullanılabilirlik Ölçeği, Türkçe, Geçerlilik

References

• Bahrick, H. P., Hall, L. K., Goggin, J. P., Bahrick, L. E., & Berger, S. A. (1994). Fifty years of language maintenance and language dominance in bilingual Hispanic immigrants. Journal of Experimental Psychology: General, 123, 264–283. Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An Empirical Evaluation Of The System Usability Scale. International Journal Of Human-Computer Interaction, 24(6), 574–594. Https://Doi.Org/10.1080/10447310802205776 Blažica, B., & Lewis, J. R. (2015). A Slovene Translation Of The System Usability Scale: The SUS-SI. International Journal Of Human-Computer Interaction, 31(2), 112–117. Https://Doi.Org/10.1080/10447318.2014.986634 Brooke, J. (1996). SUS - A Quick And Dirty Usability Scale. Usability Evaluation İn Industry, 189(194), 4–7. Https://Doi.Org/10.1002/Hbm.20701 Brooke, J. (2013). SUS : A Retrospective. Journal Of Usability Studies, 8(2), 29–40. Https://Doi.Org/10.1074/Jbc.R115.675280 Büyüköztürk, Ş., Çakmak, E. K., Akgün, Ö. E., Karadeniz, Ş., & Demirel, F. (2017). Bilimsel Araştırma Yöntemleri. Pegem Atıf İndeksi, 1-360. Büyüköztürk, Ş. (2010). Sosyal Bilimler İçin Veri Analizi El Kitabı, Pegem Akademi Yayıncılık, Ankara. Cronbach, L. J. (1951). Coefficient Alpha And The İnternal Structure Of Tests* Lf~ J. Cronbach, 16(3), 297–298. Çokluk, Ö., Şekercioğlu, G. Ve Büyüköztürk, Ş. (2012). Sosyal Bilimler İçin Çok Değişkenli İstatistik: SPSS Ve Lisrel Uygulamaları,Pegem Akademi Yayıncılık, Ankara. Davis, D. (1989). Perceived Usefulness, Perceived Ease Of Use, And User Acceptance Of Information Technology. MIS Quarterly, 13, 319–339. Delgado, P., Guerrero, G., Goggin, J. P., & Ellis, B. B.(1999). Self-Assessment Of Linguistic Skills By Bilingual Hispanics. Hispanic Journal Of Behavioral Sciences, 21,31–46. Dillon, A. (2001) Usability Evaluation. In W. Karwowski (Ed.) Encyclopedia Of Human Factors And Ergonomics, London: Taylor And Francis. Dianat, I., Ghanbari, Z., & Asgharijafarabadi, M. (2014). Psychometric Properties Of The Persian Language Version Of The System Usability Scale. Health Promotion Perspectives, 4(1), 82–9. Https://Doi.Org/10.5681/Hpp.2014.011 Forlizzi, J., & Battarbee, K. (2004). Understanding Experience İn Interactive Systems. Human-Computer Interaction Institute, 37(2), 261–268. Https://Doi.Org/10.1145/1013115.1013152 Harper, B. D., & Norman, K. L. (1998). Improving User Satisfaction: The Questionnaire For User İnteraction Satisfaction Version 5.5. Proceedings Of Mid Atlantic Human Factors Conference, 224–228. Hornbæk, K. (2006). Current Practice İn Measuring Usability: Challenges To Usability Studies And Research. International Journal Of Human Computer Studies, 64(2), 79–102. Https://Doi.Org/10.1016/J.İjhcs.2005.06.002 Isemonger, I. & Sheppard, C. (2007). A Construct-Related Validity Study On A Korean Version Of The Perceptual Learning Styles Preference Questionnaire. Educational And Psychological Measurement, 67(2), 357-368 ISO, 1998. Ergonomic Requirements For Office Work With Visual Display Terminals (Vdts)-Part 11: Guidance On Usability—Part 11: Guidance On Usability (ISO 9241-11:1998). Jordan, P. W. (1998). An Introduction To Usability. CRC Press. Kampf, M., & Payne, S. (2000). What İs Beautiful İs Usable. Interacting With Computers, 13(December), 127–145. Karagöz, Y. Ve Kösterelioğlu, İ. (2008). ―İletişim Becerileri Değerlendirme Ölçeğinin Faktör Analizi Metodu İle Geliştirilmesi‖ Dumlupınar Üniversitesi Sosyal Bilimler Dergisi, 21, 81-98. Lewis, J. R. (1995). IBM Computer Usability Satisfaction Questionnaires : Psychometric Evaluation And İnstructions For Use IBM Computer Usability Satisfaction Questionnaires : Psychometric Evaluation And İnstructions For Use. International Journal Of Human- Computer Interaction, 7(1), 57–78. Https://Doi.Org/10.1037/T32698-000 M.Sweeney, M.Maguire, B. S. (1993). Evaluating User-Computer İnteraction: A Framework. International Journal Of Man-Machine Studies, 38(4). Mack, Z., & Sharples, S. (2009). The Importance Of Usability İn Product Choice: A Mobile Phone Case Study. Ergonomics, 52(12), 1514–1528. Https://Doi.Org/10.1080/00140130903197446 Macleod, M (1994) Usability İn Context: Improving Quality Of Use. In: G Bradley And HW Hendricks (Eds.) Human Factors İn Organizational Design And Management - IV - Proceedings Of The International Ergonomics Association 4th International Symposium On Human Factors İn Organizational Design And Management, (Stockholm, Sweden, May 29 - June 1 1994). Amsterdam, Elsevier. Martins, A. I., Rosa, A. F., Queirós, A., Silva, A., & Rocha, N. P. (2015). European Portuguese Validation Of The System Usability Scale (SUS). Procedia Computer Science, 67(Dsai), 293–300. Https://Doi.Org/10.1016/J.Procs.2015.09.273 Maxwell, B. (1996). Translation And Cultural Adaptation Of The Survey Instruments. In: Martin, M. O. & Kelly, D. L. (Eds.). Third International Mathematics And Science Study (TIMSS) Technical Report, Volume I: Design And Development. Chestnut Hill, MA: Boston College. Nielsen,J (04.01.2018). Usability 101: Introduction To Usability [Available Online At: Https://Www.Nngroup.Com/Articles/Usability-101-İntroduction-To-Usability/], Retrieved On February 22th, 2018. Nielsen, J. (1992). Finding Usability Problems Through Heuristic Evaluation. Proceedings Of The SIGCHI Conference On Human Factors İn Computing Systems - CHI ’92, 373–380. Https://Doi.Org/10.1145/142750.142834 Nielsen, J. (1993). Usability Engineering. Morgan Kaufmann Pietquin O And Beaufort R, 44(1/2002), 362. Https://Doi.Org/10.1145/1508044.1508050 Nunnally, J. C. (1978). Psychometric Theory (2nd Ed.). New York: Mcgraw-Hill.Barnette, J. J. (2000). Effects Of Stem And Likert Response Option Reversals On Survey İnternal Consistency: If You Feel The Need, There İs A Better Alternative To Using Those Negatively Worded Stems. Educational And Psychological Measurement, 60, 361–370. Pilotte, W. J., & Gable, R. K. (1990). The Impact Of Positive And Negative İtem Stems On The Validity Of A Computer Anxiety Scale. Educational And Psychological Measurement, 50, 603–610. Rubin, J., & Chisnell, D. (2008). Handbook Of Usability Testing [Electronic Resource] : How To Plan, Design, And Conduct Effective Tests (2nd Ed.). Indianapolis, IN: Wiley Pub. Https://Doi.Org/10.1007/S13398-014-0173-7.2 Sauro, J., & Lewis, J. R. (2011). When Designing Usability Questionnaires, Does İt Hurt To Be Positive? In Proceedings Of CHI 2011 (Pp. 2215–2223). Vancouver, Canada: ACM. Sauro, J., & Lewis, J. R. (2012). Quantifying The User Experience. Practical Statistics For User Research. Morgan Kaufmann. Https://Doi.Org/10.1007/S13398-014-0173-7. Seneler, C. (2014). The Impact Of Learning Styles And Cultural Background On Users' Experience Of Websites. Phd Thesis. University Of York. Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating The Fit Of Structural Equation Models: Tests Of Significance And Descriptive Goodness-Of-Fit Measures. Methods Of Psychological Research Online, 8(2), 23–74. Https://Doi.Org/10.1002/0470010940 Schmitt, N., & Stuits, D. (1985) Factors Defined By Negatively Keyed İtems: The Result Of Careless Respondents? Applied Psychological Measurement, 9,367–373. Schriesheim, C. A., & Hill, K. D. (1981). Controlling Acquiescence Response Bias By İtem Reversals: The Effect On Questionnaire Validity. Educational And Psychological Measurement, 41, 1101–1114. Sears, A., & Jacko, J. (2008). The Human – Computer İnteraction Handbook. 2008 By Taylor & Francis Group, LLC. Tabachnick, B. G. Ve Fidell, L. S. (2007). Using Multivariate Statistics. Boston: Pearson Education Inc. Thüring, M., & Mahlke, S. (2007). Usability, Aesthetics And Emotions İn Human-Technology İnteraction. International Journal Of Psychology, 42(4), 253–264. Https://Doi.Org/10.1080/00207590701396674 Thompson, B., & Levitov, J. E. (1985). Using Microcomputers To Score And Evaluate Test Items. Collegiate Microcomputer, 3, 163-168. Tullis, T., & Albert, B. (2013). Measuring The User Experience: Collecting, Analysing, And Presenting Usability Matrics. Measuring The User Experience (Second Edition). Https://Doi.Org/Http://Dx.Doi.Org/10.1016/B978-0-12-415781-1.00007-8 Tullis, T. S., & Stetson, J. N. (2004). A Comparison Of Questionnaires For Assessing Website Usability. Wong, N., Rindfleisch, A., & Burroughs, J. (2003). Do Reverse-Worded Items Confound Measures in Cross-Cultural Consumer Research? The Case Of The Material Values Scale. Journal of Consumer Research, 30, 72–91.