Digital Competence Scale (DCS): A Scale Development Study

Abstract

The main purpose of this scale development is to develop a Digital Competency Scale with high validity and reliability to assess the digital competencies of employees in all institutions and organizations, public or private sector. During the scale development process, a literature review on employee digital competencies was conducted in order to create a theoretical basis. Based on the literature, an item pool reflecting employee digital competence was created and item simplification, test and retest analysis, exploratory and confirmatory factor analysis were conducted in a pilot study. The results of the analysis show that the Digital Competency Scale has high internal consistency, test-retest reliability, and exploratory and confirmatory construct validity. The Digital Competence Scale consists of the dimensions of Employee Perception of Digital Competence, Employee Perception of Digital Adaptability and Employee Perception of Digital Anxiety. The Digital Competency Scale is a reliable and valid tool for measuring and assessing the digital competencies of employees working in all institutions and organizations. By using the Digital Competency Scale, organizations can learn about their employees' strengths and weaknesses in digital skills and facilitate the implementation of targeted strategies to improve digital capabilities.

Keywords

• Digital Citizenship
• Digital Competence
• Digital Confidence
• Digital Anxiety
• Digital Literacy

Dijital Yetkinlik Ölçeği (DYÖ): Geçerlilik ve Güvenirlik Çalışması

Abstract

Bu ölçek geliştirmenin temel amacı, kamu veya özel sektör olmak üzere tüm kurum ve kuruluşlarda işgörenlerin dijital yetkinliklerini değerlendirmek için geçerliliği ve güvenirliği yüksek bir Dijital Yetkinlik Ölçeği geliştirmektir. Ölçek geliştirme sürecinde önce teorik temel oluşturmak amacıyla işgören dijital yetkinlikleri ile ilgili literatür incelemesi yapılmıştır. Literatürden hareketle işgören dijital yetkinliğini yansıtan madde havuzu oluşturularak pilot çalışmayla madde sadeleştirilmesi, test ve tekrar test analizi, keşfedici ve doğrulayıcı faktör analizi yapılmıştır. Analiz sonuçları, Dijital Yetkinlik Ölçeği’nin yüksek bir iç tutarlılığa, test-tekrar test güvenilirliğine, keşfedici ve doğrulayıcı yapı geçerliliğine sahip olduğunu göstermektedir. Dijital Yetkinlik Ölçeği; İşgören Dijital Yetkinlik Algısı, İşgören Dijital Uyum Algısı ve İşgören Dijital Kaygı Algısı boyutlarından oluşmaktadır. Dijital Yetkinlik Ölçeği, tüm kurum ve kuruluşlarda çalışan işgörenlerin dijital yetkinliklerini ölçmek ve değerlendirmek için güvenilir ve geçerli bir araçtır. Dijital Yetkinlik Ölçeği kullanılarak, kuruluşlar işgörenlerin dijital becerilerdeki güçlü ve zayıf yönleri hakkında bilgi edinebilir ve dijital yetenekleri geliştirmek için hedeflenen stratejilerin uygulanmasını kolaylaştırabilir.

Keywords

• Dijital Vatandaşlık
• Dijital Yetkinlik
• Dijital Güven
• Dijital Kaygı
• Dijital Okuryazarlık

Supporting Institution

Bu çalışma, 122G157 numaralı “Başarılı Bir Dijital Dönüşümün Yol Haritası Ve Belediyelerde Dijital Olgunluk Düzeyinin Belirlenmesi” başlıklı proje ile TÜBİTAK tarafından desteklenmektedir.

References

1. Abubakar, D., & Adetimirinz, A. (2015). Influence of Computer Literacy on Postgraduates Use of E-Resources in Nigerian University Libraries. Library Philosophy and Practice.
2. Adamovic, M., Gahan, P., Olsen, J., Gulyas, A., Shallcross, D., & Mendoza, A. (2022). Exploring the adoption of virtual work: the role of virtual work self-efficacy and virtual work climate. The International Journal of Human Resource Management, 33(17), 3492-3525. https://doi.org/10.1080/09585192.2021.1913623
3. Albright, J. J. ve Park, H. M. (2009). Confirmatory factor analysis using amos, LISREL, Mplus, The Trustees of Indiana University. USA.
4. Al-Rahmi, W. M., Alzahrani, A. I., Yahaya, N., Alalwan, N., & Kamin, Y. B. (2020). Digital communication: Information and communication technology (ICT) usage for education sustainability. Sustainability, 12(12), 5052. https://doi.org/10.3390/su12125052
5. Balcı, A. (2004). Sosyal Bilimlerde Araştırma: Yöntem, Teknik ve İlkeler. Pegem Akademi Yayıncılık, Ankara.
6. Barnes, S. J. (2020). Information management research and practice in the post-COVID-19 world. International Journal of Information Management, 55, 102175. https://doi.org/10.1016/j.ijinfomgt.2020.102175
7. Barragán-Sánchez, R., Corujo-Vélez, M.-C., Palacios-Rodríguez, A. & Román-Graván, P. (2020). Teaching digital competence and eco-responsible use of technologies: Development and validation of a scale. Sustainability, 12(18), 7721.
8. Bleijenbergh, R., Mestdagh, E., Timmermans, O., Van Rompaey, B., & Kuipers, Y. J. (2023). Digital adaptability competency for healthcare professionals: a modified explorative e-Delphi study. Nurse Education in Practice, 67, 103563. https://doi.org/10.1016/j.nepr.2023.103563

9. Bordi, L., Okkonen, J., Mäkiniemi, J. P., & Heikkilä-Tammi, K. (2018). Communication in the digital work environment: implications for wellbeing at work. Nord. J. Work. Life. Stud. 8(S3), 29-48
10. Buckingham, D. (2015). Defining digital literacy-What do young people need to know about digital media?. Nordic journal of digital literacy, 10 (Jubileumsnummer), 21-35.
11. Cahen, F., & Borini, F. M. (2020). International digital competence. Journal of International Management, 26(1), 100691.
12. Castek, J., Manderino, M., & Jacobs, G. E. (2018). Digital problem solving: The literacies of navigating life in the digital age. Journal of Adolescent & Adult Literacy, 61(6), 681-685.
13. Chonsalasin, D., & Khampirat, B. (2022). The impact of achievement goal orientation, learning strategies, and digital skill on engineering skill self-efficacy in Thailand. IEEE Access, 10, 11858-11870.
14. Cohen, L., Manion, L. & Morrison, K. (2000). Research Methods in Education, (5th ed). Routledge Falmer, Taylor&Francis Group.
15. Çokluk, Ö., Şekercioğlu, G. ve Büyüköztürk, Ş. (2012). Sosyal bilimler için çok değişkenli istatistik: SPSS ve LISREL uygulamaları (Vol. 2): Pegem Akademi Ankara.
16. D'Urso, P. A., Graham, D., Krell, R., Maul, J. P., Pernsteiner, C., Shelton, D. K., & Piercy, G. W. (2015). An exploration of organizational structure and strategy in virtual organizations: A literature review. Journal of Perspectives in Organizational Behavior, Management, & Leadership, 1(1), 25-40.
17. Erkorkmaz, Ü., Etikan, İ., Demir, O., Özdamar, K. ve Sanisoğlu,
18. S. Y. (2013). Doğrulayıcı faktör analizi ve uyum indeksleri. Turkiye Klinikleri Journal of Medical Sciences, 33(1), 210-223. https://doi.org/10.5336/medsci.2011-26747
19. Faulconer, E. (2021). eService-Learning: A decade of research in undergraduate online service-learning. American Journal of Distance Education, 35(2), 100-117.
20. Firk, S., Gehrke, Y., & Wolff, M. (2023). Digital Anxiety in the Finance Function: Consequences and Mitigating Factors. Journal of Management Accounting Research, Forthcoming.
21. Fornell, C. ve Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of marketing research, 18(1), 39-50.
22. Gansser, O., & Schultz, C. D. (2020). Perception of digitalization across a typology of consumer behavior: an abstract. In Enlightened Marketing in Challenging Times: Proceedings of the 2019 AMS World Marketing Congress (WMC) 22 (pp. 305-306).
23. Garini, R. A., & Muafi, M. (2023). The effect of digital competence, work life balance and work stress towards service performance with moderation of emotional intelligence on employees of PT. X. International Journal of Business Ecosystem & Strategy (2687-2293), 5(2), 01-11.
24. Geçkil, T. ve Tikici, M. (2015). Örgütsel Demokrasi Ölçeği Geliştirme Çalışması. Amme İdaresi Dergisi, 48(4).
25. Gümüş, M. M. ve Kukul, V. (2023). Developing a digital competence scale for teachers: validity and reliability study. Education and Information Technologies, 28(3), 2747-2765.
26. Gürses, F. (2016). Türkiye'de Yerel Yönetimlerde Yöneticiler ve Vatandaşlar Perspektifinden e-Devlet'in Benimsenmesi: Bursa Büyükşehir Belediyesi Örneği (Yayımlanmamış Doktora Tezi, Bursa Uludağ Üniversitesi (Türkiye).
27. Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E. ve Tatham, R. (2006). Multivariate data analysis . Uppersaddle River. In: NJ: Pearson Prentice Hall.
28. Hair, J. F., Sarstedt, M., Ringle, C. M. ve Mena, J. A. (2012). An assessment of the use of partial least squares structural equation modeling in marketing research. Journal of the academy of marketing science, 40(3), 414-433.
29. Hassan, M. M., & Mirza, T. (2021). The digital literacy in teachers of the schools of Rajouri (J&K)-India: Teachers perspective. International Journal of Education and Management Engineering, 11(1), 28-40.
30. Huda, M. (2023). Between accessibility and adaptability of digital platform: investigating learners' perspectives on digital learning infrastructure. Higher Education, Skills and Work-Based Learning.
31. Hurwitz, L. B., & Schmitt, K. L. (2020). Can children benefit from early internet exposure? Short-and long-term links between internet use, digital skill, and academic performance. Computers & Education, 146, 103750.
32. Joreskog, K. ve Sorbom, D. (1993). Structural Equation Modelling: Guidelines for Determining Model Fit. NY: University Press of America.
33. Karasar, N. (2009). Bilimsel arastirma yöntemi. (19.Baskı). Ankara: Nobel Yayin Dagitim.
34. Khaleel, I., Wimmer, B. C., Peterson, G. M., Zaidi, S. T. R., Roehrer, E., Cummings, E., & Lee, K. (2020). Health information overload among health consumers: A scoping review. Patient education and counseling, 103(1), 15-32.
35. Kim, H. N., Freddolino, P. P., & Greenhow, C. (2023). Older adults' technology anxiety as a barrier to digital inclusion: a scoping review. Educational Gerontology, 1-18.
36. Kitowski, J. A. C. E. K., & Kryza, B. (2011). Dynamic virtual organization management framework supporting distributed industrial collaboration. Computer Methods in Materials Science, 11(4), 514-523.
37. Kline, P. (2014). An easy guide to factor analysis: Routledge.
38. Kline, R. (2015). Principles and practice of structural equation modeling. (2.Baskı). New York, NY: The Guilford Press
39. Lee, B. R. (2017). Use of Drawing as a Communication Tool for alleviating digital anxiety: Exploring digital anxiety in smart mobile users (Yayınlanmamış Doktora Tezi, Goldsmiths, University of London).
40. Lindgren, P. (2022). "The Vitual Business Model"-Towards a Virtualized Communications World-Challenges and Opportunities. Towards Future Technologies for Business Ecosystem Innovation, 137-154.
41. Lindgren, P., & Wuropulos, K. (2017). Secure persuasive business models and business model innovation in a world of 5G. Wireless Personal Communications, 96, 3569-3583.
42. MacKenzie, S. B. ve Podsakoff, P. M. (2012). Common method bias in marketing: Causes, mechanisms, and procedural remedies. Journal of retailing, 88(4), 542-555.
43. Matt, C., Hess, T., & Benlian, A. (2015). Digital transformation strategies. Business & information systems engineering, 57, 339-343.
44. Merkevičius, J., Davidavičienė, V., Raudeliūnienė, J., & Buleca, J. (2015). Virtual organization: specifics of creation of personnel management system. Economics and Management.
45. Narmanlioğlu, H. ve Bayrakci, S. (2021). Digital Literacy as Whole of Digital Competences: Scale Development Study. [Digital Literacy as Whole of Digital Competences: Scale Development Study]. Düşünce ve Toplum Sosyal Bilimler Dergisi(4), 1-30.
46. Nevalainen, M., Kuikka, L., Sjöberg, L., Eriksson, J., & Pitkälä, K. (2012). Tolerance of uncertainty and fears of making mistakes among fifth-year medical students. Family Medicine-Kansas City, 44(4), 240.
47. Nordén, L.-Å., Mannila, L
48. . & Pears, A. (2017). Development of a self-efficacy scale for digital competences in schools. Paper presented at the 2017 IEEE Frontiers in education conference (FIE).
49. Özcan, K. ve Balyer, A. (2013). Liderlik oryantasyon ölçeğinin Türkçeye uyarlanması. Mersin Üniversitesi Eğitim Fakültesi Dergisi, 9(1), 136-150.
50. Özdamar, K. (2004). Tabloların oluşturulması, güvenirlik ve soru analizi. Paket programlarla istatistiksel veri analizi-1. 5th ed. Eskişehir: Kaan Kitabevi, 201(50), 117-150.
51. Pedaste, M., Kallas, K. & Baucal, A. (2023). Digital competence test for learning in schools: Development of items and scales. Computers & Education, 104830.
52. Prajogo, D., Toy, J., Bhattacharya, A., Oke, A., & Cheng, T. C. E. (2018). The relationships between information management, process management and operational performance: Internal and external contexts. International Journal of Production Economics, 199, 95-103. https://doi.org/10.1016/j.ijpe.2018.02.019 Puckett, C. C. (2015). Technological change, digital adaptability, and social inequality (Doktora Tezi, Northwestern University).
53. Rassenfoss, S. (2019). The Digital Future of E&P Can Lead to Data-Driven Anxiety. Journal of Petroleum Technology, 71(04), 36-38. https://doi.org/10.2118/0419-0036-JPT
54. Rathore, F. A., & Farooq, F. (2020). Information overload and infodemic in the COVID-19 pandemic. J Pak Med Assoc, 70(5), S162-S165. https://doi.org/10.5455/JPMA.38
55. Rusly, F. H., Talib, Y. Y. A., Hussin, M. R. A., & Abd Mutalib, H. (2021). Modelling the Internal Forces of SMEs digital adaptation strategy towards industry Revolution 4.0. Polish Journal of Management Studies, 24(1), 306-321.
56. Sá, M. J., Santos, A. I., Serpa, S., & Ferreira, C. M. (2021). Digital Literacy in Digital Society 5.0. Academic Journal of Interdisciplinary Studies, 10(2), 1-9.
57. Saputra, N., Nugroho, R., Aisyah, H., & Karneli, O. (2021). Digital skill during covid-19: effects of digital leadership and digital collaboration. Jurnal Aplikasi Manajemen, 19(2), 272-281. https://doi.org/10.21776/ub.jam.2021.019.02.04
58. Scherer, R. F., Luther, D. C., Wiebe, F. A. & Adams, J. S. (1988). Dimensionality of coping: Factor stability using the ways of coping questionnaire. Psychological reports, 62(3), 763-770.
59. Spante, M., Hashemi, S. S., Lundin, M., & Algers, A. (2018). Digital competence and digital literacy in higher education research: Systematic review of concept use. Cogent Education, 5(1), 1519143.
60. Suslov, M. (2015). The Medium for Demonic Energies:'Digital Anxiety'in the Russian Orthodox Church. Digital Icons: Studies in Russian, Eurasian and Central European New Media, 14(2015), 2-25.
61. Sümbüloğlu, V. ve Sümbüloğlu, K. (2005), Klinik ve saha araştirmalarinda örnekleme yöntemleri ve büyüklüğü, Alp Ofset Matbaacılık Ltd. Şti., Ankara.
62. Tarhan, Ö. (2015). Sosyal bilgiler öğretmeni adaylarının politik okuryazarlığa ilişkin görüşleri. Akademik Sosyal Araştırmalar Dergisi, 9, 649-669.
63. Tezbaşaran, A. (1996). Likert Tipi Ölçek Geliştirme Kılavuzu, Psikologlar Derneği Yayınları. Ankara.
64. Thompson, L. (2021). Virtual collaboration won't be the death of creativity. MIT Sloan Management Review, 62(2), 42-46.
65. Tsai, M. J., Liang, J. C., & Hsu, C. Y. (2021). The computational thinking scale for computer literacy education. Journal of Educational Computing Research, 59(4), 579-602.
66. Tutar, H. ve Erdem, A. T. (2022). Örnekleriyle bilimsel araştirma yöntemleri ve-SPSS uygulamaları. Seçkin Yayıncılık
67. Tzafilkou, K., Perifanou, M. & Economides, A. A. (2022). Development and validation of students’ digital competence scale (SDiCoS). International Journal of Educational Technology in Higher Education, 19(1), 30.
68. Valter, P., Lindgren, P., & Prasad, R. (2018). Advanced business model innovation supported by artificial intelligence and deep learning. Wireless Personal Communications, 100, 97-111.
69. Vecchi, A., Della Piana, B., Feola, R., & Crudele, C. (2021). Talent management processes and outcomes in a virtual organization. Business Process Management Journal, 27(7), 1937-1965.
70. Venturi, V., Stagni, F., Gianoli, A., Ceccanti, A., & Ciaschini, V. (2007, December). Virtual organization management across middleware boundaries. In Third IEEE International Conference on e-Science and Grid Computing (eScience 2007) (pp. 545-552).
71. Wang, J. L., Chiou, J. M., & Müller, H. G. (2016). Functional data analysis. Annual Review of Statistics and its application, 3, 257-295.
72. Wang, X., Wang, Z., Wang, Q., Chen, W. & Pi, Z. (2021). Supporting digitally enhanced learning through measurement in higher education: Development and validation of a university students' digital competence scale. Journal of Computer Assisted Learning, 37(4), 1063-1076.
73. Wulandari, M. C., Putro, T. R., & Prasetyani, D. (202
74. 2). Digital transformation and innovation towards university resilience and competitive advantage in Indonesia. Journal of Open Innovation: Technology, Market, and Complexity, 8(1), 28.
75. Yıldırım, A. ve Şimşek, H. (2005). Sosyal bilimlerde nitel araştirma yöntemleri. Seçkin Yayıncılık.