HAKEM ALIŞTIRMA ALIŞKANLIKLARI FORMU (HAAF): YENİ BİR ÖLÇME ARACININ TANITIMI

Öz

Pratik alışkanlıkları bir alanın ve o alanla uğraşanların gelişmişlik düzeyini gösteren önemli bir ölçüttür. Buna rağmen hakem pratikleri ile ilgili literatürdeki kanıtlar oldukça sınırlıdır ve hakemlerin pratik alışkanlıklarını belirlemeye yarayan ulusal bir ölçme aracı bulunmamaktadır. Bu araştırmanın amacı, hakemlerin alıştırma alışkanlıklarını belirlemeye yarayan kullanışlı ve güvenilir yeni bir form geliştirmektir. Hakem Alıştırma Alışkanlıklar Formu (HAAF)’ın geliştirilmesinde çok aşamalı sistematik anket geliştirme sürecinden yararlanılmıştır. Form geliştirme sürecinde kapsamlı literatüre taraması ve 8 uzmanla yapılan yarı yapılandırılmış görüşmelerin ardından (hakem antrenman sorumlusu (n=2), hakem gözlemcisi (n=2), hakem (n=4)), HAAF’ın ilk taslağı oluşturulmuştur. Bir sonraki aşamada, HAAF’taki alıştırmaların anlam ve uygunluğunun belirlenmesinde 8 uzman görüşüne dayanarak (spor bilimci (n=2), hakem antrenman sorumlusu (n=2), hakem (n=4)) formun kapsam geçerlik oranı hesaplanmış (uygunluk için 0,94, anlaşılırlık için 0,97), uzmanlar tarafından yazım hataları ve anlam bozukluları gözden geçirilerek maddeler tekrar düzenlenmiştir. Son aşamada, HAAF, ön uygulama için 50 hakeme çevrim içi yollarla gönderilmiş (Jotform® aracılığıyla), maddelere verilen sıklık ve süre cevaplarıyla formun yakınsak geçerliliği hesaplanmıştır (Spearman ρ = 0,67). 10 hakem tarafından form 1 hafta sonra tekrar doldurularak test-tekrar test güvenirliği saptanmıştır (sıklık cevapları için Cohen κ = 0,73; süre cevapları için SKK = 0,69). Sonucunda, HAAF formu; müsabaka hazırlık süreci, müsabaka sırası ve sonrası ve genel alıştırmalar olmak üzere toplam üç bölüm ve 29 alıştırma alışkanlığını belirleyecek bir form şeklinde yapılandırılmıştır (Ortalama cevap süresi = 9:33 ± 05:49 dk). Araştırma kanıtları HAAF’ın futbol hakemlerinin alıştırma alışkanlıklarını belirlemede geçerli ve kabul edilebilir düzeyde güvenilir bir ölçme aracı olduğunu göstermektedir. HAAF, hakemlerin hazırlık ve alıştırma alışkanlıklarının sistematik biçimde değerlendirilmesinde kullanılabilir.

Anahtar Kelimeler

• Hakem
• Futbol
• Alıştırma
• Anket Geliştirme
• Pratik
• Futbol Hakemleri

DEVELOPMENT AND VALIDATION OF THE REFEREE PRACTICE ACTIVITIES QUESTIONNAIRE (RPAQ)

Abstract

Practice patterns are a crucial indicator of the developmental status of a field and its professionals. Nevertheless, the existing evidence in the literature concerning referee practices remains rather limited. The aim of this study is to develop a reliable new instrument designed to assess referees’ training practices. The Referee Practice Activities Questionnaire-RPAQ (Hakem Alıştırma Alışkanlıkları Formu-HAAF) was developed through a systematic and multi-stage survey development procedures. The initial version of the RPAQ was developed based on an extensive literature review and semi-structured interviews with eight experts, including referee coaches (n = 2), referee assessors (n = 2), and referees (n = 4). In the subsequent phase, eight experts (sport scientists, n = 2; referee training supervisors, n = 2; referees, n = 4) evaluated the content validity of the RPAQ. The content validity ratio (CVR) was calculated at .94 for relevance and .97 for clarity. Following experts feedback, items were revised to correct spelling and semantic inconsistencies. At the final phase, the RPAQ was distributed to 50 officials via Jotform® for preliminary evaluation. The convergent validity of the instrument was assessed by examining the frequency and duration of responses to the items (Spearman’s rho (ρ) = .67). and test–retest reliability was evaluated by having nine officials complete the form again one week later (for frequency responses, Cohen κ = .73; for duration responses, ICC = .69).Thus, the RPAQ consists of 29 practice activities organised into three categories: pre-competition preparation, during and post competition, and general practice activities (mean response time = 9:33 ± 05:49 min). In conclusion, the RPAQ is a valid and acceptably reliable measurement tool for identifying the practice activities of soccer officials. It can be particularly useful in planning referee training programmes and in systematically evaluating referees’ preparation and practice activities. The development of the HAAF can be regarded as a step towards addressing the lack of measurement instruments within the realm of refereeing

Keywords

• Referees
• Officials
• Practice
• Training
• Football
• Sports Officials

References

1. Öden Acar, A., Huyar, D. A., Ertürk, E., & Alakan, Y. Ş. (2020). A survey development study for determining the characteristics of foreign students. Journal of Higher Education and Science, 10(2), 276–285
2. American Educational Research Association (AERA), American Psychological Association (APA), & National Council on Measurement in Education (NCME). (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association
3. Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.). Prentice Hall.
4. Amatori, S., Helsen, W. F., Baldari, C., Serra, T., Belli, A., Guidetti, L., Rocchi, M. B. L., Sisti, D., & Perroni, F. (2024). High-speed efforts of elite association football referees in national and international matches. Journal of Strength and Conditioning Research, 38(8), e417–e422. https://doi.org/10.1519/JSC.0000000000004821
5. Artino, A. R., La Rochelle, J. S., Dezee, K. J., & Gehlbach, H. (2014). Developing questionnaires for educational research: AMEE guide No. 87. Medical Teacher, 36(6), 463–474. https://doi.org/10.3109/0142159X.2014.889814
6. Blake, C., Sherry, J., & Gissane, C. (2009). A survey of referee participation, training and injury in elite Gaelic games referees. BMC Musculoskeletal Disorders, 10(1), 74. https://doi.org/10.1186/1471-2474-10-74
7. Büyüköztürk, Ş., Kılıç Çakmak, E., Akgün, Ö. E., Karadeniz, Ş., & Demirel, F. (2018). Bilimsel araştırma yöntemleri (25. baskı). Ankara: Pegem Akademi.
8. Brace, I. (2018). Questionnaire design: How to plan, structure and write survey material for effective market research (4th ed.). Kogan Page Publishers.

9. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait–multimethod matrix. Psychological Bulletin, 56(2), 81–105. https://doi.org/10.1037/h0046016
10. Castagna, C., Abt, G., & D’Ottavio, S. (2007). Physiological aspects of soccer refereeing performance and training. Sports Medicine, 37(7), 625–646. https://doi.org/10.2165/00007256-200737070-00006
11. Castillo, D., Yanci, J., Cámara, J., & Weston, M. (2016). The influence of soccer match play on physiological and physical performance measures in soccer referees and assistant referees. Journal of Sports Sciences, 34(6), 557–563. https://doi.org/10.1080/02640414.2015.1101646
12. Catteeuw, P., Helsen, W., Gilis, B., & Wagemans, J. (2009). Decision-making skills, role specificity, and deliberate practice in association football refereeing. Journal of Sports Sciences, 27(11), 1125–1136. https://doi.org/10.1080/02640410903079179
13. Costa, E. C., Vieira, C. M., Moreira, A., Ugrinowitsch, C., Castagna, C., & Aoki, M. S. (2013). Monitoring external and internal loads of Brazilian soccer referees during official matches. Journal of Sports Science and Medicine, 12(3), 559–564.
14. Cunningham, I., Mergler, J., & Wattie, N. (2022). Training and development in sport officials: A systematic review. Scandinavian Journal of Medicine & Science in Sports, 32(4), 654–671. https://doi.org/10.1111/sms.14128
15. Di Salvo, V., Carmont, M. R., & Maffulli, N. (2011). Football officials’ activities during matches: A comparison of activity of referees and linesmen in European, Premiership and Championship matches. Muscles, Ligaments and Tendons Journal, 1(3), 106–111. https://pmc.ncbi.nlm.nih.gov/articles/PMC3666476
16. Elo, S., Kääriäinen, M., Kanste, O., Pölkki, T., Utriainen, K., & Kyngäs, H. (2014). Qualitative content analysis: A focus on trustworthiness. SAGE Open, 4(1), 1–10. https://doi.org/10.1177/2158244014522633
17. Ericsson, K. A. (2014). The road to excellence: The acquisition of expert performance in the arts and sciences, sports, and games. Psychology Press.
18. FIFA Communications Division, Information Services. (2007). FIFA Big Count 2006: 270 million people active in football. Zurich: FIFA
19. Giske, R., Haugen, T., & Johansen, B. T. (2016). Training, mental preparation and unmediated practice among soccer referees: An analysis of elite and sub-elite referees’ reported practice. International Journal of Applied Sports Sciences, 28(1), 31–41.
20. Helsen, W. F., & Bultynck, J. B. (2004). Physical and perceptual-cognitive demands of top-class refereeing in association football. Journal of Sports Sciences, 22(2), 179–189. https://doi.org/10.1080/02640410310001641502
21. Hoffmann, T., MacMahon, C., & Brand, R. (2024). The game management framework for sports refereeing: A structured perspective on officiating performance and its development. German Journal of Exercise and Sport Research. Advance online publication. https://doi.org/10.1007/s12662-024-00978-y
22. Johanson, G. A., & Brooks, G. P. (2010). Initial scale development: Sample size for pilot studies. Educational and Psychological Measurement, 70(3), 394–400. https://doi.org/10.1177/0013164409355692
23. Kline, P. (2015). A handbook of test construction: Introduction to psychometric design. Routledge.
24. Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
25. Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
26. Mack, M., Schulenkorf, N., Adair, D., & Bennie, A. (2018). Factors influencing the development of elite-level sports officials in Australia: The AFL, ABA and FFA. Sport in Society, 21(9), 1240–1257. https://doi.org/10.1080/17430437.2017.1388781
27. MacMahon, C., Helsen, W. F., Starkes, J. L., & Weston, M. (2007). Decision-making skills and deliberate practice in elite association football referees. Journal of Sports Sciences, 25(1), 65–78. https://doi.org/10.1080/02640410600718640
28. Mallo, J., Navarro, E., Aranda, J. M. G., & Helsen, W. F. (2009). Activity profile of top-class association football referees in relation to fitness-test performance and match standard. Journal of Sports Sciences, 27(1), 9–17. https://doi.org/10.1080/02640410802298227
29. Martinez-Santos, R., Castillo, D., & Los Arcos, A. (2016). Sprint and jump performances do not determine the promotion to professional elite soccer in Spain, 1994–2012. Journal of Sports Sciences, 34(24), 2279–2285. https://doi.org/10.1080/02640414.2016.1190460
30. Martínez-Torremocha, G., Alonso-Callejo, A., García-Unanue, J., Gallardo, L., Sánchez-Sánchez, J., & Felipe, J. L. (2022). How do technical and tactical demands of football matches affect the physical performance of elite football referees? Exploring the role of experience. Journal of Strength and Conditioning Research. https://doi.org/10.1519/JSC.0000000000004902
31. McEwan, G. P., Unnithan, V. B., Easton, C., & Arthur, R. (2020). Development and validation of the Referee Training Activity Questionnaire (RTAQ): Towards a better understanding of the training practices of soccer officials. Journal of Sports Sciences, 38(24), 2782–2793. https://doi.org/10.1080/02640414.2020.1800371
32. McEwan, G. P., Unnithan, V. B., Easton, C., & Arthur, R. (2023). Training practices and perceptions of soccer officials: Insights from the Referee Training Activity Questionnaire. International Journal of Sports Science & Coaching, 18(4), 1173–1189. https://doi.org/10.1177/17479541221110707
33. Patton, M. Q. (2001). Qualitative research and evaluation methods (3rd ed.). Sage.
34. Pollio, H. R., Henley, T. B., & Thompson, C. J. (1997). The phenomenology of everyday life. Cambridge University Press
35. Randall, D. M., & Fernandes, M. F. (1991). The social desirability response bias in ethics research. Journal of Business Ethics, 10(11), 805–817. https://doi.org/10.1007/BF00383696
36. Robinson, G., & O’Donoghue, P. (2007). A weighted kappa statistic for reliability testing in performance analysis of sport. International Journal of Performance Analysis in Sport, 7(1), 12–19. https://doi.org/10.1080/24748668.2007.11868383
37. Sabag, E. (2022). The contribution of deliberate practice to achieving a level of expertise in basketball referees: A two-phase mixed-design study (Doctoral dissertation, University of Haifa, Israel). ProQuest Dissertations Publishing
38. Veneziano, L., & Hooper, J. (1997). A method for quantifying content validity of health-related questionnaires. American Journal of Health Behavior, 21(1), 67–70.
39. Weston, M., Castagna, C., Impellizzeri, F. M., Rampinini, E., & Abt, G. (2010). Ageing and physical match performance in English Premier League soccer referees. Journal of Science and Medicine in Sport, 13(1), 96–100. https://doi.org/10.1016/j.jsams.2008.07.009
40. Weston, M., Gregson, W., Castagna, C., Breivik, S., Impellizzeri, F. M., & Lovell, R. J. (2011). Changes in a top-level soccer referee’s training, match activities, and physiology over an 8-year period: A case study. International Journal of Sports Physiology and Performance, 6(2), 281–286. https://doi.org/10.1123/ijspp.6.2.281
41. Yaşlı, B. Ç., Karayiğit, R., Karabıyık, H., & Koz, M. (2020). Antrenman yükü ölçüm yöntemleri: Bilimsel yaklaşım. Turkiye Klinikleri Journal of Sports Sciences, 12(3), 421–433. https://doi.org/10.5336/sportsci.2020-75415