Research Article
BibTex RIS Cite

SEÇİM MÜLAKATLARINDA KAYGI ÖLÇEĞİ (MASI)’NİN TÜRKÇEYE UYARLANMASI: GEÇERLİK VE GÜVENİRLİK ÇALIŞMASI

Year 2024, Volume: 26 Issue: 2, 785 - 814, 15.06.2024
https://doi.org/10.16953/deusosbil.1378381

Abstract

Bu çalışmanın temel amacı, Türkiye'deki bir örneklem grubunda MASI'nin (Measure of Anxiety in Selection Interviews) psikometrik özelliklerini belirlemektir. Araştırmada toplam 782 katılımcıya ulaşılmıştır. Anket sorularının %5’i ve daha fazlasını boş bırakan (n = 176) ve daha önce sta j/iş mülakatı deneyimi olmayan (n = 158) katılımcılar veri analizine dâhil edilmemiştir. Nihai örneklem, yaşları 18 ile 63 arasında değişen ( X̄ = 29.04, SS = 9.99) 448 katılımcıdan (252 kadın, 196 erkek) oluşmaktadır. Katılımcılara Seçim Mülakatlarında Kaygı Ölçeği (MASI), Liebowitz Sosyal Kaygı Ölçeği ve İletişim Kaygısı Ölçeği (İKÖ-24) uygulanmıştır. Ölçeğin faktör yapısını belirlemek için açımlayıcı ve doğrulayıcı faktör analizi uygulanmıştır. Açımlayıcı faktör analizi bulguları, MASI-Türkçe (MASI-T)’nin 30 madde ve 4 faktörden oluştuğunu göstermiştir. Bu faktörler iletişim kaygısı, sosyal-görünüm kaygısı, performans kaygısı ve davranışsal kaygı olarak isimlendirilmiştir. Faktörlerin varyansın %58’ini açıkladığı tespit edilmiştir. Ölçek maddelerinin faktör yük değerlerinin ise .34 ile .78 arasında değiştiği görülmüştür. Açımlayıcı faktör analizinden sonra yapılan doğrulayıcı faktör analizinde verinin modele kabul edilebilir düzeyde uyum gösterdiği tespit edilmiştir (CFI = .91, NFI = .86, GFI = .86, IFI = .91, AGFI=.83, TLI = .90, ve RMSEA = .061). Ölçeğin ölçüt bağıntılı geçerliğinde diğer iki ölçek ile yüksek düzeyde korelasyon bulunmuştur. Ölçeğin Cronbach alfa iç tutarlık katsayısı .95 olarak bulunmuştur. Her kaygı boyutu için iç tutarlılık katsayıları şu şekildedir: iletişim = .81, sosyal-görünüm = .91, performans = .89 ve davranışsal =.85. Ayrıca bulgular, kadınların ve şu anda bir işte çalışmayan bireylerin erkeklere ve halen çalışmakta olan katılımcılara göre daha yüksek kaygı düzeyine sahip olduğunu göstermiştir. Yaş ve son mülakattaki öznel performans değerlendirmesi, kaygı puanları ile negatif ilişkilidir. Bu sonuçlar, MASI-T’nin geçerli ve güvenilir bir ölçme aracı olduğunu göstermektedir.

References

  • Anderson, N., Born, M. & Cunningham-Snell, N. (2002). Recruitment and selection: Applicant perspectives and outcomes. N. Anderson, D. S. Ones, H. K. Sinangil, C. Viswesvaran (Der.), Handbook of industrial, work and organizational psychology (vol. 1 Personnel Psychology) içinde (ss. 200–218). London: Sage.
  • Anderson, N., Salgado, J. F. & Hülsheger, U. R. (2010). Applicant reactions in selection: Comprehensive meta‐analysis into reaction generalization versus situational specificity. International Journal of Selection and Assessment, 18 (3), 291-304. doi: 10.1111/j.1468-2389.2010.00512.x
  • Ayres, J. & Crosby, S. (1995). Two studies concerning the predictive validity of the personal report of communication apprehension in employment interviews. Communication Research Reports, 12 (2), 145-151. doi: 10.1080/08824099509362050
  • Ayres, J., Keereetaweep, T., Chen, P. & Edwards, P. A. (1998). Communication apprehension and employment interviews. Communication Education, 47 (1), 1–17. doi:10.1080/03634529809379106
  • Banki, S. & Latham, G. P. (2010). The criterion‐related validities and perceived fairness of the situational interview and the situational judgment test in an Iranian organisation. Applied Psychology, 59 (1), 124-142. doi: 10.1111/j.1464-0597.2009.00418.x
  • Baumgartner, H. & Homburg, C. (1996). Applications of structural equation modeling in marketing and consumer research: A review. International Journal of Research in Marketing, 13 (2), 139-161. doi: 10.1016/0167-8116(95)00038-0
  • Behroozi, M., Shirolkar, S., Barik, T. & Parnin, C. (2020). Does stress impact technical interview performance? Proceedings of the 28th ACM Joint Meeting European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’20) içinde (ss. 481–492). doi:10.1145/3368089.3409712.
  • Bentler, P. M. (1980). Multivariate analysis with latent variables: Causal modeling. Annual Review of Psychology, 31 (1), 419-456. doi: 10.1146/annurev.ps.31.020180.002223
  • Borges, T., Ramos, S., Vilar, E., Noriega, P. & Rebelo, F. (2015). Interview anxiety narrative validation for a virtual reality-based study. Procedia Manufacturing, 3, 5934-5940. doi: 10.1016/j.promfg.2015.07.682
  • Brunswik, E. (1956). Perception and the Representative Design of Psychological Experiments. Berkeley, CA: University of California Press.
  • Byrne, B. M. (2010). Structural equation modeling with AMOS, (2nd ed.). New York: Routledge.
  • Carless, S. A. & Imber, A. (2007). The influence of perceived interviewer and job and organizational characteristics on applicant attraction and job choice intentions: The role of applicant anxiety. International Journal of Selection and Assessment, 15 (4), 359-371. doi: 10.1111/j.1468-2389.2007.00395.x
  • Carver, C. S. & Scheier, M. F. (1981). Attention and Self-Regulation: A Control Theory Approach to Human Behavior. New York: Springer. doi: 10.1007/978-1-4612-5887-2
  • Chang, Y. & Edwards, J. K. (2015). Examining the relationships among self-efficacy, coping, and job satisfaction using social career cognitive theory: An SEM analysis. Journal of Career Assessment, 23 (1), 35-47. doi: 10.1177/1069072714523083
  • Clark, D. M. & Wells, A. (1995). A cognitive model of social phobia. R. G. Heimberg, M. R. Liebowitz, D. A. Hope, F. R. Schneier (Der.), Social phobia: Diagnosis, assessment, and treatment içinde (ss. 69–93). The Guilford Press.
  • Constantin, K. L., Powell, D. M. & McCarthy, J. M. (2021). Expanding conceptual understanding of interview anxiety and performance: Integrating cognitive, behavioral, and physiological features. International Journal of Selection and Assessment, 29 (2), 234-252. doi: 10.1111/ijsa.12326
  • Cook, K. W., Vance, C. A. & Spector, P. E. (2000). The relation of candidate personality with selection-interview outcomes. Journal of Applied Social Psychology, 30 (4), 867–885. doi: 10.1111/j.1559-1816.2000.tb02828.x
  • Çakmak, V. (2018). İletişim Kaygısı ve Sosyal Medya. İstanbul: Eğitim Yayınevi.
  • Damian, I., Baur, T., Lugrin, B., Gebhard, P., Mehlmann, G. & André, E. (2015). Games are better than books: In-situ comparison of an interactive job interview game with conventional training. Artificial Intelligence in Education: 17th International Conference (June 22-26, 2015) içinde (ss. 84-94). Springer International Publishing.
  • Davies, J., Heasman, B., Livesey, A., Walker, A., Pellicano, E. & Remington, A. (2023). Access to employment: A comparison of autistic, neurodivergent and neurotypical adults' experiences of hiring processes in the United Kingdom. Autism: The International Journal of Research and Practice, 27 (6), 1746–1763. doi:10.1177/13623613221145377
  • Dibner A. S. (1956). Cue-counting: a measure of anxiety in interviews. Journal of Consulting Psychology, 20 (6), 475–478. doi: 10.1037/h0045312
  • Eysenck, M. W., Derakshan, N., Santos, R. & Calvo, M. G. (2007). Anxiety and cognitive performance: Attentional control theory. Emotion, 7 (2), 336–353. doi:10.1037/1528-3542.7.2.336
  • Feeney, J. R., McCarthy, J. M., & Goffin, R. (2015). Applicant anxiety: Examining the sex‐linked anxiety coping theory in job interview contexts. International Journal of Selection and Assessment, 23 (3), 295-305. doi: 10.1111/ijsa.12115
  • Feiler, A. R. & Powell, D. M. (2013). Interview anxiety across the sexes: Support for the sex-linked anxiety coping theory. Personality and Individual Differences, 54 (1), 12-17. doi: 10.1016/j.paid.2012.07.030
  • Feiler, A. R. & Powell, D. M. (2016). Behavioral Expression of Job Interview Anxiety. Journal of Business and Psychology, 31 (1), 155–171. doi: 10.1007/s10869-015-9403-z
  • Forza, C. & Filippini, R. (1998). TQM impact on Quality Conformance and Customer Satisfaction: A Causal Model. International Journal of Production Economics, 55 (1), 1-20. doi: 10.1016/S0925-5273(98)00007-3
  • Freeman, T., Sawyer, C. R. & Behnke, R. R. (1997). Behavioral inhibition and the attribution of public speaking state anxiety. Communication Education, 46 (3), 175-187. doi: 10.1080/10570310209374747
  • Grillon, H., Riquier, F., Herbelin, B. & Thalmann, D. (2006). Virtual reality as a therapeutic tool in the confines of social anxiety disorder treatment. International Journal on Disability and Human Development, 5 (3), 243-250. doi:10.1515/ijdhd.2006.5.3.243
  • Gül, A. (2010). Benlik Düzenleme Odakları, Otantiklik ve İlişkisel/özerk Benlik Ketlenmesi, Yayımlanmamış yüksek lisans tezi, Mersin Üniversitesi, Mersin.
  • Hall, N. C., Jackson Gradt, S. E., Goetz, T. & Musu-Gillette, L. E. (2011). Attributional retraining, self-esteem, and the job interview: Benefits and risks for college student employment. The Journal of Experimental Education, 79 (3), 318-339. doi: 10.1080/00220973.2010.503247
  • Hart, T. A., Flora, D. B., Palyo, S. A., Fresco, D. M., Holle, C. & Heimberg, R. G. (2008). Development and examination of the social appearance anxiety scale. Assessment, 15 (1), 48-59.
  • Hausknecht, J. P., Day, D. V. & Thomas, S. C. (2004). Applicant reactions to selection procedures: An updated model and meta‐analysis. Personnel Psychology, 57 (3), 639-683. doi: 10.1111/j.1744-6570.2004.00003.x
  • Heimberg, R. G., Horner, K. J., Juster, H. R., Safren, S. A., Brown, E. J., Schneier, F. R. & Liebowitz, M. R. (1999). Psychometric properties of the Liebowitz social anxiety scale. Psychological Medicine, 29 (1), 199-212. doi: 10.1017/s0033291798007879
  • Hoffman, Y. S. G., Grossman, E. S., Bergman, Y. S. & Bodner, E. (2021). The link between social anxiety and intimate loneliness is stronger for older adults than for younger adults. Aging & Mental Health, 25 (7), 1246-1253. doi: 10.1080/13607863.2020.1774741
  • Hollandsworth, J. G., Jr, Glazeski, R. C. & Dressel, M. E. (1978). Use of social-skills training in the treatment of extreme anxiety and deficient verbal skills in the job-interview setting. Journal of Applied Behavior Analysis, 11 (2), 259–269. doi: 10.1901/jaba.1978.11-259
  • Hu, L. T. & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6 (1), 1-55. doi: 10.1080/10705519909540118
  • Huffcutt, A. I., Van Iddekinge, C. H. & Roth, P. L. (2011). Understanding applicant behavior in employment interviews: A theoretical model of interviewee performance. Human Resource Management Review, 21 (4), 353-367. doi:10.1016/j.hrmr.2011.05.003
  • Hülsheger, U. R. & Anderson, N. (2009). Applicant perspectives in selection: Going beyond preference reactions. International Journal of Selection and Assessment, 17 (4), 335-345. doi: 10.1111/j.1468-2389.2009.00477.x
  • JDP (2020). How to prepare for interviews. https://www.jdp.com/blog/how-to-prepare-for-interviews-2020/ (Erişim Tarihi: 18.06.2022)
  • Jones, D. B. & Pinkney, J. W. (1989). An exploratory assessment of the sources of job-interviewing anxiety in college students. Journal of College Student Development, 30 (6), 553-60.
  • Judge, T. A., Cable, D. M. & Higgins, C. A. (2000). The employment interview: A review of recent research and recommendations for future research. Human Resource Management Review, 10 (4), 383-406. doi: 10.1016/S1053-4822(00)00033-4
  • Kaliannan, M., Darmalinggam, D., Dorasamy, M. & Abraham, M. (2023). Inclusive talent development as a key talent management approach: A systematic literature review. Human Resource Management Review, 33 (1), 100926. doi: 10.1016/j.hrmr.2022.100926
  • Kline, R. B. (2011). Convergence of structural equation modeling and multilevel modeling. M. Williams & W. P. Vogt (Der.), Handbook of Methodological Innovation içinde (ss. 562–589) Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781446268261.n31
  • Kyriazos, T. A. (2018). Applied psychometrics: sample size and sample power considerations in factor analysis (EFA, CFA) and SEM in general. Psychology, 9 (08), 2207-2230. doi:10.4236/psych.2018.98126
  • Langer, M., König, C. J., Gebhard, P. & André, E. (2016). Dear computer, teach me manners: Testing virtual employment interview training. International Journal of Selection and Assessment, 24 (4), 312-323. doi: 10.1111/ijsa.12150
  • Lievens, F., De Corte, W. & Brysse, K. (2003). Applicant perceptions of selection procedures: The role of selection information, belief in tests, and comparative anxiety. International Journal of Selection and Assessment, 11 (1), 67-77. doi: 10.1111/1468-2389.00227
  • Lin-Stephens, S. & Manuguerra, M. (2023). Using visual stimuli in narrative career interventions: effects of image-supported storytelling on interview anxiety and performance. International Journal for Educational and Vocational Guidance, 1-27. doi: 10.1007/s10775-023-09603-0
  • Lukacik, E. R., Bourdage, J. S. & Roulin, N. (2022). Into the void: A conceptual model and research agenda for the design and use of asynchronous video interviews. Human Resource Management Review, 32 (1), 100789. doi: 10.1016/j.hrmr.2020.100789
  • Macan, T. (2009). The employment interview: A review of current studies and directions for future research. Human Resource Management Review, 19 (3), 203-218.
  • Marsh, H. W., Hau, K. T., Artelt, C., Baumert, J. & Peschar, J. L. (2006). OECD's brief self-report measure of educational psychology's most useful affective constructs: Cross-cultural, psychometric comparisons across 25 countries. International Journal of Testing, 6 (4), 311-360. doi: 10.1207/s15327574ijt0604_1
  • Mastrella, S. J., Powell, D. M., Bonaccio, S. & McMurtry, C. M. (2023). The impact of interviewees’ anxious nonverbal behavior on interview performance ratings. Journal of Personnel Psychology, 22 (2), 99–110. doi: 10.1027/1866-5888/a000319
  • McCarthy, J. M. & Goffin, R. D. (2005). Selection test anxiety: Exploring tension and fear of failure across the sexes in simulated selection scenarios. International Journal of Selection and Assessment, 13 (4), 282-295. doi: 10.1111/j.1468-2389.2005.00325.x
  • McCarthy, J. M., Bauer, T. N., Truxillo, D. M., Anderson, N. R., Costa, A. C. & Ahmed, S. M. (2017). Applicant perspectives during selection: A review addressing “So what?,”“What’s new?,” and “Where to next?”. Journal of Management, 43 (6), 1693-1725. doi: 10.1177/0149206316681846
  • McCarthy, J. M., Truxillo, D. M., Bauer, T. N., Erdogan, B., Shao, Y., Wang, M., Liff, J. & Gardner, C. (2021). Distressed and distracted by COVID-19 during high-stakes virtual interviews: The role of job interview anxiety on performance and reactions. Journal of Applied Psychology, 106 (8), 1103–1117. doi: 10.1037/apl0000943
  • McCarthy, J. M., Van Iddekinge, C. H., Lievens, F., Kung, M. C., Sinar, E. F. & Campion, M. A. (2013). Do candidate reactions relate to job performance or affect criterion-related validity? A multistudy investigation of relations among reactions, selection test scores, and job performance. Journal of Applied Psychology, 98 (5), 701-719. doi: 10.1037/a0034089
  • McCarthy, J. & Goffin, R. (2004). Measuring job interview anxiety: Beyond weak knees and sweaty palms. Personnel Psychology, 57 (3), 607-637.
  • McCroskey, J. C. (1982). An Introduction to Rtetorical Communication. Englewood Cliffs: Prentice Hall. doi: 10.4324/9781315663791
  • Melchers, K. G., Petrig, A., Basch, J. M. & Sauer, J. (2021). A comparison of conventional and technology-mediated selection interviews with regard to interviewees’ performance, perceptions, strain, and anxiety. Frontiers in Psychology, 11, 603632. doi: 10.3389/fpsyg.2020.603632
  • Meyers, L. S., Gamst, G. & Guarino, A. J. (2006). Applied Multivariate Research: Design and Interpretation. London: Sage.
  • Miller, R. O., Gayfer, B. L. & Powell, D. M. (2018). Influence of vocal and verbal cues on ratings of interview anxiety and interview performance. Personnel Assessment and Decisions, 4 (2), 26-41. doi: 10.25035/pad.2018.02.003
  • Moynihan, L. M., Roehling, M. V., LePine, M. A. & Boswell, W. R. (2003). A longitudinal study of the relationships among job search self-efficacy, job interviews, and employment outcomes. Journal of Business and Psychology, 18, 207-233. doi: 10.1023/A:1027349115277
  • Nikolaou, I. (2014). Social networking web sites in job search and employee recruitment. International Journal of Selection and Assessment, 22 (2), 179-189. doi: 10.1111/ijsa.12067
  • O'Leary, B.S., Lindholm, M.L., Whitford, R.A. & Freeman, S.E. (2002) Selecting the Best and Brightest: Leveraging human capital. Human Resource Management, 41, 325–340. doi: 10.1002/hrm.10044
  • Petruzziello, G., Chiesa, R., Guglielmi, D., van der Heijden, B. I., de Jong, J. P. & Mariani, M. G. (2022). The development and validation of a multi-dimensional Job Interview Self-efficacy scale. Personality and Individual Differences, 184, 111221. doi: 10.1016/j.paid.2021.111221
  • Powell, D. M., Bourdage, J. S. & Bonaccio, S. (2021). Shake and fake: The role of interview anxiety in deceptive impression management. Journal of Business and Psychology, 36, 829-840. doi: 10.1007/s10869-020-09708-1
  • Powell, D. M., Stanley, D. J. & Brown, K. N. (2018). Meta-analysis of the relation between interview anxiety and interview performance. Canadian Journal of Behavioural Science, 50 (4), 195-207. doi: 10.1037/cbs0000108
  • Rockawin, D. (2012). Using innovative technology to overcome job interview anxiety. Australian Journal of Career Development, 21 (2), 46-52. doi: 10.1177/103841621202100206
  • Ryan, A. M. & Ployhart, R. E. (2000). Applicants’ Perceptions of Selection Procedures and Decisions: A Critical Review and Agenda for the Future. Journal of Management, 26 (3), 565–606. doi:10.1177/014920630002600308
  • Santos, A. C., Arriaga, P. & Simoes, C. (2021). Psychometric validation of the Portuguese version of the Measure of Anxiety in Selection Interviews. International Journal of Selection and Assessment, 29 (2), 285-292. doi: 10.1111/ijsa.12323
  • Schlenker, B. R. & Leary, M. R. (1982). Social anxiety and self-presentation: A conceptualization model. Psychological Bulletin, 92 (3), 641–669. doi:10.1037/0033-2909.92.3.641
  • Schmit, M. J. & Ryan, A. M. (1997). Applicant withdrawal: The role of test‐taking attitudes and racial differences. Personnel Psychology, 50 (4), 855-876. doi: 10.1111/j.1744-6570.1997.tb01485.x
  • Schneider, L., Powell, D. M. & Bonaccio, S. (2019). Does interview anxiety predict job performance and does it influence the predictive validity of interviews?. International Journal of Selection and Assessment, 27 (4), 328-336. doi: 10.1111/ijsa.12263
  • Sieverding, M. (2009). ‘Be Cool!’: Emotional costs of hiding feelings in a job interview. International Journal of Selection and Assessment, 17 (4), 391-401.
  • Silvester, J., Anderson‐Gough, F. M., Anderson, N. R. & Mohamed, A. R. (2002). Locus of control, attributions and impression management in the selection interview. Journal of Occupational and Organizational Psychology, 75 (1), 59-76. doi: 10.1348/096317902167649
  • Smith, M. J., Smith, J. D., Blajeski, S., Ross, B., Jordan, N., Bell, M. D. ... & Razzano, L. A. (2022). An RCT of virtual reality job interview training for individuals with serious mental illness in IPS supported employment. Psychiatric Services, 73 (9), 1027-1038. doi: 10.1176/appi.ps.202100516
  • Somerville, L. H. (2013). The teenage brain: Sensitivity to social evaluation. Current Directions in Psychological Science, 22 (2), 121-127. doi: 10.1177/0963721413476512
  • Soykan, C., Özgüven, H. D. & Gençöz, T. (2003). Liebowitz social anxiety scale: the Turkish version. Psychological Reports, 93 (3), 1059-1069. doi: 10.2466/pr0.2003.93.3f.1059
  • Stumpf, S. A., Austin, E. J., & Hartman, K. (1984). The impact of career exploration and interview readiness on interview performance and outcomes. Journal of Vocational Behavior, 24 (2), 221–235. doi:10.1016/0001-8791(84)90008-3
  • Swider, B. W., Barrick, M. R., Harris, T. B. & Stoverink, A. C. (2011). Managing and creating an image in the interview: The role of interviewee initial impressions. Journal of Applied Psychology, 96 (6), 1275. doi: 10.1037/a0024005
  • Şah, U. & Şah, D. E. (2022). Kültürel Bir Boyut Olarak “Bireycilik-Toplulukçuluk” ve Türkiye’deki Çalışmalar. LAÜ Sosyal Bilimler Dergisi, 13 (2), 108-121.
  • Tay, C., Ang, S. & Van Dyne, L. (2006). Personality, biographical characteristics, and job interview success: a longitudinal study of the mediating effects of interviewing self-efficacy and the moderating effects of internal locus of causality. Journal of Applied Psychology, 91 (2), 446-454. doi: 10.1037/0021-9010.91.2.446
  • Toldi, N. L. (2011). Job applicants favor video interviewing in the candidate‐selection process. Employment Relations Today, 38 (3), 19-27. doi: 10.1002/ert.20351
  • Tross, S. A. & Maurer, T. J. (2008). The effect of coaching interviewees on subsequent interview performance in structured experience‐based interviews. Journal of Occupational and Organizational Psychology, 81 (4), 589-605. doi: 10.1348/096317907X248653
  • White, M. (2022). Sample size in quantitative instrument validation studies: A systematic review of articles published in Scopus, 2021. Heliyon, 8 (12), e12223. doi: 10.1016/j.heliyon.2022.e12223
  • Wijayanti, F. I., Djatmika, D., Sumarlam, S. & Sawardi, F. X. (2022). Portraying leader characters through speech acts and politeness strategies in job interview: A gender perspective. International Journal of Society, Culture & Language, 10 (1), 41-57. doi: 10.22034/ijscl.2022.549337.2549
  • Woodzicka, J. A. (2008). Sex differences in self-awareness of smiling during a mock job interview. Journal of Nonverbal Behavior, 32 (2), 109-121. doi: 10.1007/s10919-007-0046-2
  • Wu, K. (2019, Temmuz 15). Tangible tips to beat pre-ınterview anxiety. https://www.forbes.com/sites/theyec/2019/07/15/tangible-tips-to-beat-pre-interview-anxiety/?sh=7acc98a07778 (Erişim Tarihi: 15.06.2022).
  • Young, M. J., Behnke, R. R. & Mann, Y. M. (2004). Anxiety patterns in employment interviews. Communication Reports, 17 (1), 49-57.doi: 10.1080/08934210409389373

ADAPTATION OF THE MEASURE OF ANXIETY IN SELECTION INTERVIEWS (MASI) TO TURKISH: A STUDY OF VALIDITY AND RELIABILITY

Year 2024, Volume: 26 Issue: 2, 785 - 814, 15.06.2024
https://doi.org/10.16953/deusosbil.1378381

Abstract

The main aim of this study is to determine the psychometric properties of MASI (Measure of Anxiety in Selection Interviews) in a sample group in Turkey. A total of 782 participants were reached in the research. Participants who left 5% or more of the survey questions blank (n = 176) and those who had no prior internship/job interview experience (n = 158) were not included in the data analysis. The final sample consisted of 448 participants (252 female, 196 male) with ages ranging from 18 to 63 ( X̄ = 29.04, SD = 9.99). Participants were administered the Liebowitz Social Anxiety Scale, Communication Anxiety Scale (CAS-24), and Anxiety Scale in Selection Interviews (MASI). Exploratory and confirmatory factor analysis were applied to determine the construct validity of the scale. The findings of the exploratory factor analysis indicated that MASI-Turkish (MASI-T) consisted of 30 items and 4 factors. These factors were named communication anxiety, social-appearance anxiety, performance anxiety, and behavioral anxiety. It was found that the factors explained 58% of the variance. The factor loadings of the scale items ranged from .34 to .78. After the exploratory factor analysis, the confirmatory factor analysis showed that the model adequately fit a four-factor solution (CFI = .91, NFI = .87, GFI = .86, IFI = .91, AGFI=.83, TLI = .91, and RMSEA = .061). High levels of correlation were found between the scale and the other two scales in criterion-related validity. The internal consistency coefficient of the scale was found to be .95. The internal consistency coefficients for each anxiety dimension were as follows: communication = .81, social-appearance = .91, performance = .89, and behavioral = .85. Additionally, the findings indicated that females and individuals currently not employed exhibited higher levels of anxiety compared to males and currently employed participants. Age and subjective performance evaluation in the last interview were negatively correlated with anxiety scores. These results demonstrate that MASI-T is a valid and reliable measurement tool.

References

  • Anderson, N., Born, M. & Cunningham-Snell, N. (2002). Recruitment and selection: Applicant perspectives and outcomes. N. Anderson, D. S. Ones, H. K. Sinangil, C. Viswesvaran (Der.), Handbook of industrial, work and organizational psychology (vol. 1 Personnel Psychology) içinde (ss. 200–218). London: Sage.
  • Anderson, N., Salgado, J. F. & Hülsheger, U. R. (2010). Applicant reactions in selection: Comprehensive meta‐analysis into reaction generalization versus situational specificity. International Journal of Selection and Assessment, 18 (3), 291-304. doi: 10.1111/j.1468-2389.2010.00512.x
  • Ayres, J. & Crosby, S. (1995). Two studies concerning the predictive validity of the personal report of communication apprehension in employment interviews. Communication Research Reports, 12 (2), 145-151. doi: 10.1080/08824099509362050
  • Ayres, J., Keereetaweep, T., Chen, P. & Edwards, P. A. (1998). Communication apprehension and employment interviews. Communication Education, 47 (1), 1–17. doi:10.1080/03634529809379106
  • Banki, S. & Latham, G. P. (2010). The criterion‐related validities and perceived fairness of the situational interview and the situational judgment test in an Iranian organisation. Applied Psychology, 59 (1), 124-142. doi: 10.1111/j.1464-0597.2009.00418.x
  • Baumgartner, H. & Homburg, C. (1996). Applications of structural equation modeling in marketing and consumer research: A review. International Journal of Research in Marketing, 13 (2), 139-161. doi: 10.1016/0167-8116(95)00038-0
  • Behroozi, M., Shirolkar, S., Barik, T. & Parnin, C. (2020). Does stress impact technical interview performance? Proceedings of the 28th ACM Joint Meeting European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’20) içinde (ss. 481–492). doi:10.1145/3368089.3409712.
  • Bentler, P. M. (1980). Multivariate analysis with latent variables: Causal modeling. Annual Review of Psychology, 31 (1), 419-456. doi: 10.1146/annurev.ps.31.020180.002223
  • Borges, T., Ramos, S., Vilar, E., Noriega, P. & Rebelo, F. (2015). Interview anxiety narrative validation for a virtual reality-based study. Procedia Manufacturing, 3, 5934-5940. doi: 10.1016/j.promfg.2015.07.682
  • Brunswik, E. (1956). Perception and the Representative Design of Psychological Experiments. Berkeley, CA: University of California Press.
  • Byrne, B. M. (2010). Structural equation modeling with AMOS, (2nd ed.). New York: Routledge.
  • Carless, S. A. & Imber, A. (2007). The influence of perceived interviewer and job and organizational characteristics on applicant attraction and job choice intentions: The role of applicant anxiety. International Journal of Selection and Assessment, 15 (4), 359-371. doi: 10.1111/j.1468-2389.2007.00395.x
  • Carver, C. S. & Scheier, M. F. (1981). Attention and Self-Regulation: A Control Theory Approach to Human Behavior. New York: Springer. doi: 10.1007/978-1-4612-5887-2
  • Chang, Y. & Edwards, J. K. (2015). Examining the relationships among self-efficacy, coping, and job satisfaction using social career cognitive theory: An SEM analysis. Journal of Career Assessment, 23 (1), 35-47. doi: 10.1177/1069072714523083
  • Clark, D. M. & Wells, A. (1995). A cognitive model of social phobia. R. G. Heimberg, M. R. Liebowitz, D. A. Hope, F. R. Schneier (Der.), Social phobia: Diagnosis, assessment, and treatment içinde (ss. 69–93). The Guilford Press.
  • Constantin, K. L., Powell, D. M. & McCarthy, J. M. (2021). Expanding conceptual understanding of interview anxiety and performance: Integrating cognitive, behavioral, and physiological features. International Journal of Selection and Assessment, 29 (2), 234-252. doi: 10.1111/ijsa.12326
  • Cook, K. W., Vance, C. A. & Spector, P. E. (2000). The relation of candidate personality with selection-interview outcomes. Journal of Applied Social Psychology, 30 (4), 867–885. doi: 10.1111/j.1559-1816.2000.tb02828.x
  • Çakmak, V. (2018). İletişim Kaygısı ve Sosyal Medya. İstanbul: Eğitim Yayınevi.
  • Damian, I., Baur, T., Lugrin, B., Gebhard, P., Mehlmann, G. & André, E. (2015). Games are better than books: In-situ comparison of an interactive job interview game with conventional training. Artificial Intelligence in Education: 17th International Conference (June 22-26, 2015) içinde (ss. 84-94). Springer International Publishing.
  • Davies, J., Heasman, B., Livesey, A., Walker, A., Pellicano, E. & Remington, A. (2023). Access to employment: A comparison of autistic, neurodivergent and neurotypical adults' experiences of hiring processes in the United Kingdom. Autism: The International Journal of Research and Practice, 27 (6), 1746–1763. doi:10.1177/13623613221145377
  • Dibner A. S. (1956). Cue-counting: a measure of anxiety in interviews. Journal of Consulting Psychology, 20 (6), 475–478. doi: 10.1037/h0045312
  • Eysenck, M. W., Derakshan, N., Santos, R. & Calvo, M. G. (2007). Anxiety and cognitive performance: Attentional control theory. Emotion, 7 (2), 336–353. doi:10.1037/1528-3542.7.2.336
  • Feeney, J. R., McCarthy, J. M., & Goffin, R. (2015). Applicant anxiety: Examining the sex‐linked anxiety coping theory in job interview contexts. International Journal of Selection and Assessment, 23 (3), 295-305. doi: 10.1111/ijsa.12115
  • Feiler, A. R. & Powell, D. M. (2013). Interview anxiety across the sexes: Support for the sex-linked anxiety coping theory. Personality and Individual Differences, 54 (1), 12-17. doi: 10.1016/j.paid.2012.07.030
  • Feiler, A. R. & Powell, D. M. (2016). Behavioral Expression of Job Interview Anxiety. Journal of Business and Psychology, 31 (1), 155–171. doi: 10.1007/s10869-015-9403-z
  • Forza, C. & Filippini, R. (1998). TQM impact on Quality Conformance and Customer Satisfaction: A Causal Model. International Journal of Production Economics, 55 (1), 1-20. doi: 10.1016/S0925-5273(98)00007-3
  • Freeman, T., Sawyer, C. R. & Behnke, R. R. (1997). Behavioral inhibition and the attribution of public speaking state anxiety. Communication Education, 46 (3), 175-187. doi: 10.1080/10570310209374747
  • Grillon, H., Riquier, F., Herbelin, B. & Thalmann, D. (2006). Virtual reality as a therapeutic tool in the confines of social anxiety disorder treatment. International Journal on Disability and Human Development, 5 (3), 243-250. doi:10.1515/ijdhd.2006.5.3.243
  • Gül, A. (2010). Benlik Düzenleme Odakları, Otantiklik ve İlişkisel/özerk Benlik Ketlenmesi, Yayımlanmamış yüksek lisans tezi, Mersin Üniversitesi, Mersin.
  • Hall, N. C., Jackson Gradt, S. E., Goetz, T. & Musu-Gillette, L. E. (2011). Attributional retraining, self-esteem, and the job interview: Benefits and risks for college student employment. The Journal of Experimental Education, 79 (3), 318-339. doi: 10.1080/00220973.2010.503247
  • Hart, T. A., Flora, D. B., Palyo, S. A., Fresco, D. M., Holle, C. & Heimberg, R. G. (2008). Development and examination of the social appearance anxiety scale. Assessment, 15 (1), 48-59.
  • Hausknecht, J. P., Day, D. V. & Thomas, S. C. (2004). Applicant reactions to selection procedures: An updated model and meta‐analysis. Personnel Psychology, 57 (3), 639-683. doi: 10.1111/j.1744-6570.2004.00003.x
  • Heimberg, R. G., Horner, K. J., Juster, H. R., Safren, S. A., Brown, E. J., Schneier, F. R. & Liebowitz, M. R. (1999). Psychometric properties of the Liebowitz social anxiety scale. Psychological Medicine, 29 (1), 199-212. doi: 10.1017/s0033291798007879
  • Hoffman, Y. S. G., Grossman, E. S., Bergman, Y. S. & Bodner, E. (2021). The link between social anxiety and intimate loneliness is stronger for older adults than for younger adults. Aging & Mental Health, 25 (7), 1246-1253. doi: 10.1080/13607863.2020.1774741
  • Hollandsworth, J. G., Jr, Glazeski, R. C. & Dressel, M. E. (1978). Use of social-skills training in the treatment of extreme anxiety and deficient verbal skills in the job-interview setting. Journal of Applied Behavior Analysis, 11 (2), 259–269. doi: 10.1901/jaba.1978.11-259
  • Hu, L. T. & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6 (1), 1-55. doi: 10.1080/10705519909540118
  • Huffcutt, A. I., Van Iddekinge, C. H. & Roth, P. L. (2011). Understanding applicant behavior in employment interviews: A theoretical model of interviewee performance. Human Resource Management Review, 21 (4), 353-367. doi:10.1016/j.hrmr.2011.05.003
  • Hülsheger, U. R. & Anderson, N. (2009). Applicant perspectives in selection: Going beyond preference reactions. International Journal of Selection and Assessment, 17 (4), 335-345. doi: 10.1111/j.1468-2389.2009.00477.x
  • JDP (2020). How to prepare for interviews. https://www.jdp.com/blog/how-to-prepare-for-interviews-2020/ (Erişim Tarihi: 18.06.2022)
  • Jones, D. B. & Pinkney, J. W. (1989). An exploratory assessment of the sources of job-interviewing anxiety in college students. Journal of College Student Development, 30 (6), 553-60.
  • Judge, T. A., Cable, D. M. & Higgins, C. A. (2000). The employment interview: A review of recent research and recommendations for future research. Human Resource Management Review, 10 (4), 383-406. doi: 10.1016/S1053-4822(00)00033-4
  • Kaliannan, M., Darmalinggam, D., Dorasamy, M. & Abraham, M. (2023). Inclusive talent development as a key talent management approach: A systematic literature review. Human Resource Management Review, 33 (1), 100926. doi: 10.1016/j.hrmr.2022.100926
  • Kline, R. B. (2011). Convergence of structural equation modeling and multilevel modeling. M. Williams & W. P. Vogt (Der.), Handbook of Methodological Innovation içinde (ss. 562–589) Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781446268261.n31
  • Kyriazos, T. A. (2018). Applied psychometrics: sample size and sample power considerations in factor analysis (EFA, CFA) and SEM in general. Psychology, 9 (08), 2207-2230. doi:10.4236/psych.2018.98126
  • Langer, M., König, C. J., Gebhard, P. & André, E. (2016). Dear computer, teach me manners: Testing virtual employment interview training. International Journal of Selection and Assessment, 24 (4), 312-323. doi: 10.1111/ijsa.12150
  • Lievens, F., De Corte, W. & Brysse, K. (2003). Applicant perceptions of selection procedures: The role of selection information, belief in tests, and comparative anxiety. International Journal of Selection and Assessment, 11 (1), 67-77. doi: 10.1111/1468-2389.00227
  • Lin-Stephens, S. & Manuguerra, M. (2023). Using visual stimuli in narrative career interventions: effects of image-supported storytelling on interview anxiety and performance. International Journal for Educational and Vocational Guidance, 1-27. doi: 10.1007/s10775-023-09603-0
  • Lukacik, E. R., Bourdage, J. S. & Roulin, N. (2022). Into the void: A conceptual model and research agenda for the design and use of asynchronous video interviews. Human Resource Management Review, 32 (1), 100789. doi: 10.1016/j.hrmr.2020.100789
  • Macan, T. (2009). The employment interview: A review of current studies and directions for future research. Human Resource Management Review, 19 (3), 203-218.
  • Marsh, H. W., Hau, K. T., Artelt, C., Baumert, J. & Peschar, J. L. (2006). OECD's brief self-report measure of educational psychology's most useful affective constructs: Cross-cultural, psychometric comparisons across 25 countries. International Journal of Testing, 6 (4), 311-360. doi: 10.1207/s15327574ijt0604_1
  • Mastrella, S. J., Powell, D. M., Bonaccio, S. & McMurtry, C. M. (2023). The impact of interviewees’ anxious nonverbal behavior on interview performance ratings. Journal of Personnel Psychology, 22 (2), 99–110. doi: 10.1027/1866-5888/a000319
  • McCarthy, J. M. & Goffin, R. D. (2005). Selection test anxiety: Exploring tension and fear of failure across the sexes in simulated selection scenarios. International Journal of Selection and Assessment, 13 (4), 282-295. doi: 10.1111/j.1468-2389.2005.00325.x
  • McCarthy, J. M., Bauer, T. N., Truxillo, D. M., Anderson, N. R., Costa, A. C. & Ahmed, S. M. (2017). Applicant perspectives during selection: A review addressing “So what?,”“What’s new?,” and “Where to next?”. Journal of Management, 43 (6), 1693-1725. doi: 10.1177/0149206316681846
  • McCarthy, J. M., Truxillo, D. M., Bauer, T. N., Erdogan, B., Shao, Y., Wang, M., Liff, J. & Gardner, C. (2021). Distressed and distracted by COVID-19 during high-stakes virtual interviews: The role of job interview anxiety on performance and reactions. Journal of Applied Psychology, 106 (8), 1103–1117. doi: 10.1037/apl0000943
  • McCarthy, J. M., Van Iddekinge, C. H., Lievens, F., Kung, M. C., Sinar, E. F. & Campion, M. A. (2013). Do candidate reactions relate to job performance or affect criterion-related validity? A multistudy investigation of relations among reactions, selection test scores, and job performance. Journal of Applied Psychology, 98 (5), 701-719. doi: 10.1037/a0034089
  • McCarthy, J. & Goffin, R. (2004). Measuring job interview anxiety: Beyond weak knees and sweaty palms. Personnel Psychology, 57 (3), 607-637.
  • McCroskey, J. C. (1982). An Introduction to Rtetorical Communication. Englewood Cliffs: Prentice Hall. doi: 10.4324/9781315663791
  • Melchers, K. G., Petrig, A., Basch, J. M. & Sauer, J. (2021). A comparison of conventional and technology-mediated selection interviews with regard to interviewees’ performance, perceptions, strain, and anxiety. Frontiers in Psychology, 11, 603632. doi: 10.3389/fpsyg.2020.603632
  • Meyers, L. S., Gamst, G. & Guarino, A. J. (2006). Applied Multivariate Research: Design and Interpretation. London: Sage.
  • Miller, R. O., Gayfer, B. L. & Powell, D. M. (2018). Influence of vocal and verbal cues on ratings of interview anxiety and interview performance. Personnel Assessment and Decisions, 4 (2), 26-41. doi: 10.25035/pad.2018.02.003
  • Moynihan, L. M., Roehling, M. V., LePine, M. A. & Boswell, W. R. (2003). A longitudinal study of the relationships among job search self-efficacy, job interviews, and employment outcomes. Journal of Business and Psychology, 18, 207-233. doi: 10.1023/A:1027349115277
  • Nikolaou, I. (2014). Social networking web sites in job search and employee recruitment. International Journal of Selection and Assessment, 22 (2), 179-189. doi: 10.1111/ijsa.12067
  • O'Leary, B.S., Lindholm, M.L., Whitford, R.A. & Freeman, S.E. (2002) Selecting the Best and Brightest: Leveraging human capital. Human Resource Management, 41, 325–340. doi: 10.1002/hrm.10044
  • Petruzziello, G., Chiesa, R., Guglielmi, D., van der Heijden, B. I., de Jong, J. P. & Mariani, M. G. (2022). The development and validation of a multi-dimensional Job Interview Self-efficacy scale. Personality and Individual Differences, 184, 111221. doi: 10.1016/j.paid.2021.111221
  • Powell, D. M., Bourdage, J. S. & Bonaccio, S. (2021). Shake and fake: The role of interview anxiety in deceptive impression management. Journal of Business and Psychology, 36, 829-840. doi: 10.1007/s10869-020-09708-1
  • Powell, D. M., Stanley, D. J. & Brown, K. N. (2018). Meta-analysis of the relation between interview anxiety and interview performance. Canadian Journal of Behavioural Science, 50 (4), 195-207. doi: 10.1037/cbs0000108
  • Rockawin, D. (2012). Using innovative technology to overcome job interview anxiety. Australian Journal of Career Development, 21 (2), 46-52. doi: 10.1177/103841621202100206
  • Ryan, A. M. & Ployhart, R. E. (2000). Applicants’ Perceptions of Selection Procedures and Decisions: A Critical Review and Agenda for the Future. Journal of Management, 26 (3), 565–606. doi:10.1177/014920630002600308
  • Santos, A. C., Arriaga, P. & Simoes, C. (2021). Psychometric validation of the Portuguese version of the Measure of Anxiety in Selection Interviews. International Journal of Selection and Assessment, 29 (2), 285-292. doi: 10.1111/ijsa.12323
  • Schlenker, B. R. & Leary, M. R. (1982). Social anxiety and self-presentation: A conceptualization model. Psychological Bulletin, 92 (3), 641–669. doi:10.1037/0033-2909.92.3.641
  • Schmit, M. J. & Ryan, A. M. (1997). Applicant withdrawal: The role of test‐taking attitudes and racial differences. Personnel Psychology, 50 (4), 855-876. doi: 10.1111/j.1744-6570.1997.tb01485.x
  • Schneider, L., Powell, D. M. & Bonaccio, S. (2019). Does interview anxiety predict job performance and does it influence the predictive validity of interviews?. International Journal of Selection and Assessment, 27 (4), 328-336. doi: 10.1111/ijsa.12263
  • Sieverding, M. (2009). ‘Be Cool!’: Emotional costs of hiding feelings in a job interview. International Journal of Selection and Assessment, 17 (4), 391-401.
  • Silvester, J., Anderson‐Gough, F. M., Anderson, N. R. & Mohamed, A. R. (2002). Locus of control, attributions and impression management in the selection interview. Journal of Occupational and Organizational Psychology, 75 (1), 59-76. doi: 10.1348/096317902167649
  • Smith, M. J., Smith, J. D., Blajeski, S., Ross, B., Jordan, N., Bell, M. D. ... & Razzano, L. A. (2022). An RCT of virtual reality job interview training for individuals with serious mental illness in IPS supported employment. Psychiatric Services, 73 (9), 1027-1038. doi: 10.1176/appi.ps.202100516
  • Somerville, L. H. (2013). The teenage brain: Sensitivity to social evaluation. Current Directions in Psychological Science, 22 (2), 121-127. doi: 10.1177/0963721413476512
  • Soykan, C., Özgüven, H. D. & Gençöz, T. (2003). Liebowitz social anxiety scale: the Turkish version. Psychological Reports, 93 (3), 1059-1069. doi: 10.2466/pr0.2003.93.3f.1059
  • Stumpf, S. A., Austin, E. J., & Hartman, K. (1984). The impact of career exploration and interview readiness on interview performance and outcomes. Journal of Vocational Behavior, 24 (2), 221–235. doi:10.1016/0001-8791(84)90008-3
  • Swider, B. W., Barrick, M. R., Harris, T. B. & Stoverink, A. C. (2011). Managing and creating an image in the interview: The role of interviewee initial impressions. Journal of Applied Psychology, 96 (6), 1275. doi: 10.1037/a0024005
  • Şah, U. & Şah, D. E. (2022). Kültürel Bir Boyut Olarak “Bireycilik-Toplulukçuluk” ve Türkiye’deki Çalışmalar. LAÜ Sosyal Bilimler Dergisi, 13 (2), 108-121.
  • Tay, C., Ang, S. & Van Dyne, L. (2006). Personality, biographical characteristics, and job interview success: a longitudinal study of the mediating effects of interviewing self-efficacy and the moderating effects of internal locus of causality. Journal of Applied Psychology, 91 (2), 446-454. doi: 10.1037/0021-9010.91.2.446
  • Toldi, N. L. (2011). Job applicants favor video interviewing in the candidate‐selection process. Employment Relations Today, 38 (3), 19-27. doi: 10.1002/ert.20351
  • Tross, S. A. & Maurer, T. J. (2008). The effect of coaching interviewees on subsequent interview performance in structured experience‐based interviews. Journal of Occupational and Organizational Psychology, 81 (4), 589-605. doi: 10.1348/096317907X248653
  • White, M. (2022). Sample size in quantitative instrument validation studies: A systematic review of articles published in Scopus, 2021. Heliyon, 8 (12), e12223. doi: 10.1016/j.heliyon.2022.e12223
  • Wijayanti, F. I., Djatmika, D., Sumarlam, S. & Sawardi, F. X. (2022). Portraying leader characters through speech acts and politeness strategies in job interview: A gender perspective. International Journal of Society, Culture & Language, 10 (1), 41-57. doi: 10.22034/ijscl.2022.549337.2549
  • Woodzicka, J. A. (2008). Sex differences in self-awareness of smiling during a mock job interview. Journal of Nonverbal Behavior, 32 (2), 109-121. doi: 10.1007/s10919-007-0046-2
  • Wu, K. (2019, Temmuz 15). Tangible tips to beat pre-ınterview anxiety. https://www.forbes.com/sites/theyec/2019/07/15/tangible-tips-to-beat-pre-interview-anxiety/?sh=7acc98a07778 (Erişim Tarihi: 15.06.2022).
  • Young, M. J., Behnke, R. R. & Mann, Y. M. (2004). Anxiety patterns in employment interviews. Communication Reports, 17 (1), 49-57.doi: 10.1080/08934210409389373
There are 88 citations in total.

Details

Primary Language Turkish
Subjects Labor Economics and Industrial Relations, Applied and Developmental Psychology (Other), Human Resources and Industrial Relations (Other)
Journal Section Articles
Authors

Dilara Turgut 0000-0002-7945-7585

Burcu Guler 0000-0002-6179-7557

Demet Vural Yüzbaşı 0000-0002-6017-0875

Publication Date June 15, 2024
Submission Date October 19, 2023
Acceptance Date May 9, 2024
Published in Issue Year 2024 Volume: 26 Issue: 2

Cite

APA Turgut, D., Guler, B., & Vural Yüzbaşı, D. (2024). SEÇİM MÜLAKATLARINDA KAYGI ÖLÇEĞİ (MASI)’NİN TÜRKÇEYE UYARLANMASI: GEÇERLİK VE GÜVENİRLİK ÇALIŞMASI. Dokuz Eylül Üniversitesi Sosyal Bilimler Enstitüsü Dergisi, 26(2), 785-814. https://doi.org/10.16953/deusosbil.1378381