TRANSLATION, ADAPTATION, VALIDITY AND RELIABILITY OF THE SENSE-MAKING SCALE: A CROSS-CULTURAL EVIDENCE FROM INDIA, MALAYSIA, ROMANIA AND TURKEY

Abstract

The main object of this research is translation, adaptation, validity and reliability of the Sense-Making Scale’s Turkish version to English so as to be used in cross-cultural researches. Even though there are extensive studies which have been carried out on sense-making, any sense-making scale or questionnaire in the existing literature is not consistent and there is a gap that should be filled. The contribution of this research is to redound a sense-making measurement tool in English. Firstly, the related literature is reiterated and a pilot study of translated scale is applied for validity and reliablity. After reliability is assured, the surveys are sent to 600 academicians in India, Malaysia, Romania and Turkey and 466 of the data are valid. The data fit to normal distribution. Cronbach's Alpha value is found reliable (0.763) and the variability of the scale is 61.257%. The first possible explanation for these results is being the first measurement tool about sense-making in English. The second implication of the study is; sense-making of signs such as action, discourse, diagnosis, facts orelse events may let people prevent from adverse, negative and unfavourable incidents such as accidents, chaoses or crises which may occur in times to come.

Keywords

• Sense-Making Scale
• Cross-Cultural Evidence
• Scale Translation and Adaptation

ANLAMLANDIRMA ÖLÇEĞİNİN ÇEVİRİSİ, UYARLAMASI, GEÇERLİLİK VE GÜVENİLİRLİĞİ: HİNDİSTAN, MALEZYA, ROMANYA VE TÜRKİYE'DEN KÜLTÜRLERARASI BİR KANIT

Abstract

Bu araştırmanın temel amacı, Anlamlandırma Ölçeğinin Türkçe versiyonunun kültürlerarası araştırmalarda kullanılmak üzere geçerliliği, güvenirliği sağlanarak İngilizce versiyona uyarlanabilmesidir. Anlamlandırma üzerine yapılmış kapsamlı çalışmalar olmasına rağmen, İngilizce literatürde herhangi bir anlamlandırma ölçeği veya anketi bulunmamaktadır ve literatürde doldurulması gereken bir boşluk bulunmaktadır. Bu araştırmanın literatüre katkısı, İngilizce anlamlandırma ölçeği sunmaktır. İlk olarak, geçerlik ve güvenilirlik için çevirisi yapılan ölçeğin 66 akademisyenden oluşan katılımcıyla pilot çalışması uygulanmıştır. Geçerlik ve güvenilirlik sağlandıktan sonra Hindistan, Malezya, Romanya ve Türkiye'deki 600 akademisyene çevrimiçi anket e-posta ile gönderilmiştir ve 466 geçerli veri elde edilmiştir. Veriler normal dağılıma uymaktadır. Cronbach Alfa değeri güvenilir bulunmuştur (0.763) ve ölçeğin değişkenliği %61.257'dir. Bu sonuçlara göre; İngilizce olarak kullanılabilecek anlamlandırma ile ilgili ilk ölçüm aracı sağlanmaktadır. Çalışmanın ikinci önemi; eylem, söylem, tanı, gerçekler ya da diğer olaylar gibi işaretlerin anlamlandırılması; insanların gelecek zamanlarda meydana gelebilecek kaza, kaos ya da kriz gibi olumsuz ve istenmeyen olayları önlemesine izin verebilir.

Keywords

• Anlamlandırma Ölçeği Uyarlaması
• Hindistan
• Malezya
• Romanya ve Türkiye

References

1. Abbas, A., Zhou, Y., Deng, S., & Zhang, P. (2018). Text analytics to support sense-making in social media: A language-action perspective. MIS Quarterly, 42(2).
2. Acquadro C, Conway K, Hareendran A, et al. Literature review of methods to translate health-related quality of life questionnaires for use in multinational clinical trials. Value Health 2008;11:509–21.
3. Anthoine E, Moret L, Regnault A, Sébille V, Hardouin JB. Sample size used to validate a scale: A review of publications on newly-developed patient reported outcomes measures. Health Qual Life Outcomes 2014;12:176.
4. Arafat SM. Psychometric validation of the Bangla version of the patient-doctor relationship questionnaire. Psychiatry J 2016;2016:9385364.
5. Arafat, S. Y., Chowdhury, H. R., Qusar, M. S., & Hafez, M. A. (2016). Cross cultural adaptation & psychometric validation of research instruments: A methodological review. Journal of Behavioral Health, 5(3), 129-136.
6. Barry, H. "Cross-cultural research with matched pairs of societies." Journal of Social Psychology, October 1969, 79, pp. 25-33.
7. Beaton, D. E., Bombardier, C., Guillemin, F. & Ferraz, M. B. (2002) Recommendations for the cross-cultural adaptation of health status measures. Available at: http://www.dash.iwh.on.ca/assets/images/pdfs/xculture2002.pdf
8. Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186-3191.

9. Bhalla, G., and Lin, L. (1987), “Cross-cultural marketing research: a discussion of equivalence issues and measurement strategies”, Psychology and Marketing, Vol. 4 No. 4, pp. 275-85.
10. Bonomi AE, Cella DF, Hahn EA, et al. Multilingual translation of the Functional Assessment of Cancer Therapy (FACT) quality of life measurement system. Qual Life Res 1996;5:309–20.
11. Brislin R.W. (1970) Back-translation for cross-cultural research. Journal of Cross-cultural Psychology 1, 185–216.
12. Caminiti C, Diodati F, Filiberti S, Marcomini B, Annunziata MA, Ollari M, et al. Cross-cultural adaptation and patients’ judgments of a Question Prompt List for Italian-speaking cancer patients. BMC Health Serv Res 2010;10:16.
13. Cantarero, K., Van Tilburg, W. A., Kuźma, B., Gąsiorowska, A., & Wojciszke, B. (2019). Some People Probably Need to Make More Sense: An Exploratory Study on Individual Differences and the Need for Sense-Making. Polish Psychological Bulletin, 50(2), 114-118.
14. Carr, S., Gilbride, N., & James, C. (2017). School principals: Their adult ego development stage, their sense-making capabilities and how others experience them.
15. Cerulo, K. A. (2018). Scents and sensibility: olfaction, sense-making, and meaning attribution. American Sociological Review, 83(2), 361-389.
16. Chen, H. Y., & Boore, J. R. (2009). Translation and back‐translation in qualitative nursing research: methodological review. Journal of clinical nursing, 19(1‐2), 234-239.
17. Comrey, A., & Lee, H. (1992). A First Course in Factor Analysis (2nd edn.) Lawrence Earlbaum Associates. Publishers: Hillsdale, New Jersey.
18. Cooper, D. J., Ezzamel, M., & Robson, K. (2019). The Multiplicity of Performance Management Systems: Heterogeneity in Multinational Corporations and Management Sense‐Making. Contemporary Accounting Research, 36(1), 451-485.
19. Cruz FAD, Padilla GV and Agustin EO (2000) Adapting a measure of acculturation for cross-cultural research. Journal of Transcultural Nursing 11, 191–198.
20. da Mota Falcao D, Ciconelli RM, Ferraz MB. Translation and cultural adaptation of quality of life questionnaires: an evaluation of methodology. J Rheumatol 2003;30:379–85.
21. DEVELLIS, Robert. F. (2012). Scale development theory and applications (Third Edition), SAGE Publications, Inc.
22. DOUGHERTY, Debbie. S., DRUMHELLER, Kristina. (2006). “Sensemaking and emotions in organizations: Accounting for emotions in a rational(ized) context”. Communication Studies, C.57, Sayı:2, ss. 215-238.
23. DYER, Ronald. (2017). “Cultural sense-making integration into risk mitigation strategies towards megaproject success”. International journal of project management, C. 35, Sayı:7, ss. 1338-1349.
24. Emhan, A., Mete, M., & Emhan, A. (2012). Kamu ve özel sektör çalışanlarında işkoliklik ve obsesyon arasındaki ilişkinin incelenmesi. Dicle Tıp Dergisi, 39(1), 75-79.
25. Epstein, J., Osborne, R. H., Elsworth, G. R., Beaton, D. E., & Guillemin, F. (2015). Cross-cultural adaptation of the Health Education Impact Questionnaire: experimental study showed expert committee, not back-translation, added value. Journal of clinical epidemiology, 68(4), 360-369.
26. Epstein, J., Santo, R. M., & Guillemin, F. (2015). A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. Journal of clinical epidemiology, 68(4), 435-441.
27. Esposito N (2001) From meaning to meaning: the influence of translation techniques on non-English focus group research. Qualitative Health research 11, 568–579.
28. Fidell, L. S., & Tabachnick, B. G. (2014). Using multivariate statistics (New International Edition ed.).
29. Foldy, Erica Gabrielle, Laurie Goldman and Sonia Ospina (2008), “Sensegiving and the role of cognitive shifts in the work of leadership”, The Leadership Quarterly, 19 (5), p.514-529.
30. Gonc¸alves RS, Cabri J, Pinheiro JP, Ferreira PL, Gil J. Cross-cultural adaptation and validation of the Portuguese version of the intermittent and constant osteoarthritis pain (ICOAP) measure for the knee. Osteoarthritis Cartilage 2010; 18:1058e61.
31. GROSS, Margaret. K. (2010). “Sense-making in theory and practice: a metatheoretical foundation and application for health information seeking”. MSc Thesis, University of Illinois at Urbana, Illinois, ss. 1-49.
32. Guillemin, F., Bombardier, C., & Beaton, D. (1993). Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. Journal of clinical epidemiology, 46(12), 1417-1432.
33. Hagell et al. (2010). Peter Hagell, Per-Johan Hedin, David M. Meads, Lennart Nyberg, Stephen P. McKenna. Effects of Method of Translation of Patient-Reported Health Outcome Questionnaires: A Randomized Study of the Translation of the Rheumatoid Arthritis Quality of Life (RAQoL) Instrument for Sweden. International Society for Pharmacoeconomics and Outcomes Research (ISPOR) (13)4,pp. 424–430
34. Hahn, K. T., Emigh, P. J., Lenz, M., & Gire, E. (2017). Student sense-making on homework in a sophomore mechanics course. 2017 PERC Proceedings, 26-27.
35. Haverly, C., Calabrese Barton, A., Schwarz, C. V., & Braaten, M. (2020). “Making Space”: How Novice Teachers Create Opportunities for Equitable Sense-Making in Elementary Science. Journal of Teacher Education, 71(1), 63-79.
36. Henneberg, Stephan C., Peter Naudé and Stefanos Mouzas (2010), “Sense-making and management in business networks—Some observations, considerations, and a research agenda”, Industrial Marketing Management, 39(3), p.355-360.
37. Hermann, Margaret G., Bruce W. Dayton (2008), “Transboundary Crises through the Eyes of Policymakers: Sense Making and Crisis Management, ‘Surviving Future Disasters’ Conference Sponsored by the Stephenson Disaster Management Institute at Louisiana State University, New York, USA.
38. http://www.tdk.gov.tr. Erişim tarihi: 27.04.2019.
39. Hughes, N. D., Locock, L., Simkin, S., Stewart, A., Ferrey, A. E., Gunnell, D., ... & Hawton, K. (2017). Making sense of an unknown terrain: how parents understand self-harm in young people. Qualitative health research, 27(2), 215-225.
40. ITO, Kumiko., INOHARA, Takehiro. (2015). “A model of sense-making process for adapting new organizational settings; Based on case study of executive leaders in work transitions”. Procedia-Social and Behavioral Sciences, C. 172, ss. 142-149.
41. JAKOBSEN, M., WORM, V., LI, X. (2018). “Making Sense of Context in International Business: Some Methodological Reflections”. Asia Pacific Management Review. C.23, Sayı:4, ss. 251-257.
42. Karagöz, Y. (2016). SPSS ve AMOS 23 uygulamalı istatistiksel analizler. Ankara: Nobel Yayıncılık.
43. Keiichiro H (2001) Translation and ‘true language’. Research Quarterly 17, 53–54.
44. KHARCHENKOVA, Svetlana. (2018). “The market metaphors: Making sense of the emerging market for contemporary art in China”. Poetics. C.71, ss. 71-82
45. Lammers, C. J., and Hickson, D. J. "Are Organizations Culture-bound?" In Organizations Alike and Unlike, edited by C. J. Lammers and D. J. Hickson. London: Routledge & Kegan Paul Ltd., 1979.
46. Laurent, A. "Matrix Organizations and Latin Cultures: A Note on the Use of Comparative Research." International Studies of Management and Organization, Winter 1980-1981, pp. 101-114.
47. Leite P, Rangé B, Kukar-Kiney M, Ridgway N, Monroe K, Ribas Junior R, et al. Cross-cultural adaptation, validation and reliability of the Brazilian version of the Richmond Compulsive Buying Scale. Rev Bras Psiquiatr 2013;35:38-43.
48. MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological methods, 4(1), 84.
49. MAITLIS, Sally., CHRISTIANSON, Marlys. (2014). “Sensemaking in organizations: Taking stock and moving forward”. The academy of management annals, C.8, Sayı: 1, ss. 57-125.
50. Maneesriwongul W & Dixon JK (2004) Instrument translation process: a method review. Journal of Advanced Nursing 48, 175–185.
51. MATTSSON, Lars Gunnar., CORSARO, Daniela, RAMOS, Carla. (2015). “Sense-making in business markets–the interplay between cognition, action and outcomes”. Industrial Marketing Management, C.48, ss. 4-11.
52. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol 2010;63:737-745.
53. Munet-Vilar’o F. & Egan M. (1990) Reliability issues of the family environment scale for cross-cultural research. Nursing Research 39, 244–247.
54. Müller S, Kohlmann T, Wilke T. Validation of the adherence barriers questionnaire – An instrument for identifying potential risk factors associated with medication-related non-adherence. BMC Health Serv Res 2015;15:153.
55. Naresh K. Malhotra James Agarwal Mark Peterson, (1996),"Methodological issues in cross-cultural marketing research", International Marketing Review, Vol. 13 Iss 5 pp. 7 - 43
56. Nasif, E. G., Al-Daeaj, H., Ebrahimi, B., & Thibodeaux, M. S. (1991). Methodological problems in cross-cultural research: An updated review. MIR: Management International Review, 79-91.
57. Nath, R. (1968). "A Methodological Review of Cross-Cultural Management Review." International Social Science Journal, 20, pp. 35-62.
58. Nunnally JC, Bernstein IH. Psychometric Theory (3rd ed.). New York: McGraw-Hill, Inc., 1994.
59. Ola BA, Igbokwe DO. Factorial validation and reliability analysis of the Brain Fag Syndrome Scale. Afr Health Sci 2011;11:334-40.
60. Ortiz-Gutiérrez, S., & Cruz-Avelar, A. (2018). Translation and Cross-Cultural Adaptation of Health Assessment Tools. Actas dermo-sifiliograficas, 109(3), 202.
61. Örün, Ö., Orhan, D., DÖNMEZ, P., & Kurt, A. A. (2015). Öğretmen adaylarının bireysel yenilikçilik profilleri ve teknoloji tutum düzeyleri arasındaki ilişkinin incelenmesi. Trakya Üniversitesi Eğitim Fakültesi Dergisi, 5(1), 65-76.
62. Pakenham, K. I. (2007). Making sense of multiple sclerosis. Rehabilitation Psychology, 52(4), 380–389. https://doi.org/10.1037/0090-5550.52.4.380
63. Parameswaran, R. and Yaprak, A. (1987), “ A cross-national comparison of consumer research measures”, Journal of International Business Studies, Vol. 8.
64. Parsian N, Dunning AM. Developing and validating a questionnaire to measure spirituality: A psychometric process. Glob J Health Sci 2009;1:2.
65. Paula HR, Haddad A, Weiss MA, Dini GM, Ferreira LM. Translation, cultural adaptation, and validation of the American Skindex-29 quality of life index. An Bras Dermatol 2014;89:600-7.
66. Perneger TV, Leplege A, Etter JF. Cross-cultural adaptation of a psychometric instrument: two methods compared. J Clin Epidemiol 1999;52:1037–46.
67. Riva S, Gorini A, Cutica I, Mazzocco K, Pravettoni G. Translation, cross-cultural adaptation, and reliability, of the Italian version of the Passive Risk Taking (PRT) scale. Judgm Decis Mak 2015;10:597-604.
68. Santos JJ, Costa TA, Guilherme JH, Silva WC, Abentroth LR, Krebs JA, et al. Adaptation and cross-cultural validation of the Brazilian version of the Warwick-Edinburgh mental well-being scale. Rev Assoc Med Bras 2015;61:209-14.
69. Saris-Baglama RN, Dewey CJ, Chisholm GB, et al. SF Health Outcomes™ Scoring Software User’s Guide. Lincoln: Quality-Metric, Inc., 2004.
70. Schiavio, A., & De Jaegher, H. (2017). Participatory sense-making in joint musical practice. In The Routledge companion to embodied music interaction (pp. 31-39). Routledge.
71. Sekaran, U. (1983): Methodological and Theoretical Issues and Advancements in Cross-Cultural Research." Journal of International Business Studies, pp. 61-73.
72. SMEREK, Ryan. E. (2009). “Sensemaking and Sensegiving: Leadership Processes of New College Presidents”. Doctor of Philosophy in The University of Michigan.
73. Sousa, V. D., & Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross‐cultural health care research: a clear and user‐friendly guideline. Journal of evaluation in clinical practice, 17(2), 268-274.
74. Sousa, V. D., Zauszniewski, J. A., Mendes, I. A. C. & Zanetti, M. L. (2005) Cross-cultural equivalence and psychometric properties of the Portuguese version of the depressive cognition scale. Journal of Nursing Measurement, 13 (2), 87–99.
75. Stieglitz, S., Bunker, D., Mirbabaie, M., & Ehnis, C. (2017). Sense‐making in social media during extreme events. Journal of Contingencies and Crisis Management, 26(1), 4-15.
76. TILLMANN, Katia., GODDARD, Andrew. (2008). “Strategic management accounting and sense-making in a multinational company”. Management accounting research, C.19, Sayı: 1, ss. 80-102.
77. Trousselard M, Steiler D, Raphel C, Cian C, Duymedjian R, Claverie D, et al. Validation of a French version of the Freiburg Mindfulness Inventory - Short version: Relationships between mindfulness and stress in an adult population. Biopsychosoc Med 2010;4:8.
78. TUĞSAL, Türker. (2015). “Finansal Krizler ve Anlamlandırma Teorisi: 2008 Krizine Retrospektif Bir Yaklaşım”. Siyaset, ekonomi ve yönetim araştırmaları dergisi, C.2, Sayı: 2, ss. 111-124.
79. TUĞSAL, Türker. (2016). İş Yaşamında Duyguları Anlamlandırmanın Örgütlere ve Çalışanlara Faydaları (Örgüt Yönetiminde Duygular, ed. Ülgen, B.), ss. 69-90, Ankara, Nobel Yayıncılık.
80. TUĞSAL, Türker. (2018). İş-Yaşam Dengesi, Sosyal Destek ve Sosyo-Demografik Faktörlerin Tükenmişlik Üzerindeki Etkisi. İstanbul, Cinius Yayınları.
81. TUĞSAL, Türker. (2019). “Anlamlandırma Teorisi ve Anlamlandırma Ölçeği Geliştirme Çalışması: Bireylerin Çevrelerindeki Davranışları, Olayları, İşaretleri ve Farklılıkları Anlamlandırma Durumları”. Bingöl Üniversitesi Sosyal Bilimler Enstitüsü Dergisi, C.9, Sayı: 17, ss. 483-492.
82. Twinn S (1998) An analysis of the effectiveness of focus groups as a method of qualitative data collection with Chinese populations in nursing research. Journal of Advanced Nursing 28, 654–661.
83. WEICK, Karl. E. (1988). Enacted sensemaking in crisis situations. Journal of management studies, C.25, Sayı: 4, ss. 305-317.
84. Weinberg, Aaron, Emilie Wiesner and Timothy Fukawa-Connelly (2014), “Students’ sense-making frames in mathematics lectures”, The Journal of Mathematical Behavior, 33, p.168-179.
85. Wild D, Grove A, Martin M, et al. Principles of good practice for the translation and cultural adaptation Process for Patient-Reported Outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health 2005; 8:94–104.
86. Williams B, Onsman A, Brown T. Exploratory factor analysis: A fivestep guide for novices. Aust J Paramed 2010;8:1-13.
87. Wu SF (2006) Two stage translation and test the validity and reliability of a foreign instrument. The Journal of Nursing 53, 65–71.
88. XU, Sifan. (2018). “Crisis communication within a community: Bonding, coping, and making sense together”. Public Relations Review, C.44, Sayı:1, ss. 84-97.
89. Yu, J.H., Keown, C.F. and Jacobs, L.W. (1993), “Attitude scale methodology: cross-cultural implications”, Journal of International Consumer Marketing, Vol. 6 No. 2, pp. 45-64.
90. YURDUGÜL, Halil. (2005). Ölçek Geliştirme Çalışmalarında Kapsam Geçerliği için Kapsam Geçerlik Endekslerinin Kullanılması. XIV. Ulusal Eğitim Bilimleri Kongresi Pamukkale Üniversitesi Eğitim Fakültesi 28–30 Eylül 2005 DENİZLİ