Comprehensive Reliability Analysis of the "My Jump" Application: A Repeated Measures and Multiple Rater Approach

Yıl 2024, Cilt: 4 Sayı: 2, 30 - 42, 31.12.2024

Süleyman Ulupınar , Cebrail Gençoğlu , Saltanat Saydam , Yusuf Sadi Özbayraktar , Serhat Özbay

Öz

Mobile applications offer significant advantages in sports performance measurement, such as accessibility, cost-effectiveness, and ease of use. However, the reliability and accuracy of the data provided by these applications in performance evaluation are crucial. This study aimed to assess the reliability of the "My Jump" mobile application in measuring vertical jump performance across three main scenarios: (1) intra-rater reliability, (2) inter-rater reliability, and (3) the consistency of repeated jump trials by the same individual. Thirty participants with varying levels of training performed two countermovement jumps (CMJ). These jumps were analyzed by two independent raters, each evaluating the videos twice. The results were analyzed using Intraclass Correlation Coefficient (ICC) values. High reliability was observed in both intra-rater and inter-rater measurements, with ICC values of 0.99. Intra-rater analyses showed a maximum deviation of 0.8 cm, while inter-rater analyses indicated deviations of up to 1.5 cm. Although the consistency of repeated jumps by the same individual was also very high, it was relatively lower compared to the other scenarios (ICC = 0.97), with deviations of up to 4.3 cm. These findings suggest that the observed differences in measurement outcomes are more likely due to individual variations in jump performance rather than errors from the application or raters. Therefore, standardizing test procedures, particularly in terms of body and joint positioning, is critical for obtaining reliable measurements.

Anahtar Kelimeler

vertical jump, reliability, mobile applications, My Jump

Proje Numarası

TÜBİTAK–2209-A - 2023/2. Dönem

My Jump” Uygulaması için Kapsamlı bir Güvenirlik Analizi: Tekrarlı Ölçümler ve Çoklu Değerlendirici Yaklaşımı

Öz

Mobil uygulamalar, spor performans ölçümlerinde erişilebilirlik, maliyet etkinliği ve kullanım kolaylığı gibi önemli avantajlar sunmaktadır. Ancak, bu uygulamaların performans değerlendirmelerinde güvenilir ve doğru veri sağlaması büyük önem taşımaktadır. Bu çalışma, dikey sıçrama performansını ölçmek için kullanılan "My Jump" mobil uygulamasının güvenirliğini, (1) değerlendirici içi güvenirlik, (2) değerlendiriciler arası güvenirlik ve (3) aynı katılımcının tekrarlı sıçrama denemeleri arasındaki tutarlılık olmak üzere üç ana senaryo üzerinden değerlendirmeyi amaçlamaktadır. Farklı antrenman seviyesine sahip sporculardan oluşan 30 katılımcı, iki adet aktif sıçrama (countermovement jump, CMJ) gerçekleştirmiştir. Bu sıçramalar, iki bağımsız değerlendirici tarafından, her video iki kez analiz edilerek değerlendirilmiştir. Sonuçlar, sınıf-içi korelasyon katsayısı (Intraclass Correlation Coefficient, ICC) değerleri kullanılarak analiz edilmiştir. Hem değerlendirici içi hem de değerlendiriciler arası ölçümlerde yüksek güvenirlik gözlenmiş, ICC değerleri 0,99 olarak bulunmuştur. Değerlendirici içi analizlerde maksimum sapma 0,8 cm iken, değerlendiriciler arası analizlerde sapma 1,5 cm'ye kadar çıkmıştır. Ancak, aynı bireyin tekrarlı sıçrama performansları arasındaki tutarlılık da çok yüksek olmasına rağmen diğer senaryolara göre görece daha düşüktür (ICC= 0,97) ve sapmalar 4,3 cm'ye kadar ulaşmıştır. Bu bulgular, ölçüm sonuçlarındaki farkların uygulama veya değerlendiricilerden ziyade bireysel sıçrama performanslarındaki farklılıklardan kaynaklandığını öne sürmektedir. Dolayısıyla, güvenilir ölçümler elde etmek için test prosedürlerinin, özellikle vücut ve eklem pozisyonlarının standardize edilmesinin kritik olduğunu göstermektedir.

Anahtar Kelimeler

dikey sıçrama, güvenirlik, mobil uygulamalar, My Jump

Proje Numarası

TÜBİTAK–2209-A - 2023/2. Dönem

Kaynakça

• Alias, M. F., Hasan, H., Miswan, M. S., & Man, D. D. (2021). Inter-Rater Reliability and Intra-Rater Reliability Testing of My Jump 2 Mobile Application in Measuring Countermovement Jump. Journal of Human Movement and Sports Sciences, 9(6), 1319-1323. doi: https://doi.org/10.13189/saj.2021.090628
• Balsalobre-Fernández, C., Glaister, M., & Lockey, R. A. (2015). The validity and reliability of an iPhone app for measuring vertical jump performance. Journal of sports sciences, 33(15), 1574-1579. doi: https://doi.org/10.1080/02640414.2014.996184
• Barbalho, M., Kleiner, A. F. R., Callegari, B., de Lima, R. C., da Silva Souza, G., e Silva, A. d. A. C., & Coswig, V. S. (2020). Assessing interlimb jump asymmetry in young soccer players: the my jump 2 APP. International Journal of Sports Physiology and Performance, 16(1), 19-27. doi: https://doi.org/10.1123/ijspp.2019-0981
• Berriel, G. P., Cardoso, A. S., Costa, R. R., Rosa, R. G., Oliveira, H. B., Kruel, L. F. M., & Peyré-Tartaruga, L. A. (2022). Effects of postactivation performance enhancement on the vertical jump in high-level volleyball athletes. Journal of human kinetics, 82(1), 145-153. doi: https://doi.org/10.2478/hukin-2022-0041
• Bishop, C., Rubio, M. P.-H., Gullon, I. L., Maloney, S., & Balsalobre-Fernandez, C. (2022). Jump and change of direction speed asymmetry using smartphone apps: Between-session consistency and associations with physical performance. The Journal of Strength & Conditioning Research, 36(4), 927-934. doi: https://doi.org/10.1519/JSC.0000000000003567
• Bogataj, Š., Pajek, M., Andrašić, S., & Trajković, N. (2020a). Concurrent validity and reliability of my jump 2 app for measuring vertical jump height in recreationally active adults. Applied Sciences, 10(11), 3805. doi: https://doi.org/10.3390/app10113805
• Bogataj, Š., Pajek, M., Hadžić, V., Andrašić, S., Padulo, J., & Trajković, N. (2020b). Validity, reliability, and usefulness of My Jump 2 App for measuring vertical jump in primary school children. International journal of environmental research and public health, 17(10), 3708. doi: https://doi.org/10.3390/ijerph17103708
• Bosco, C., Luhtanen, P., & Komi, P. V. (1983). A simple method for measurement of mechanical power in jumping. European journal of applied physiology and occupational physiology, 50, 273-282. doi: https://doi.org/10.1007/BF00422166
• Chow, G. C.-C., Kong, Y.-H., & Pun, W.-Y. (2023). The Concurrent Validity and Test-Retest Reliability of Possible Remote Assessments for Measuring Countermovement Jump: My Jump 2, HomeCourt & Takei Vertical Jump Meter. Applied Sciences, 13(4), 2142. doi: https://doi.org/10.3390/app13042142
• Currell, K., & Jeukendrup, A. E. (2008). Validity, reliability and sensitivity of measures of sporting performance. Sports medicine, 38, 297-316. doi: https://doi.org/10.2165/00007256-200838040-00003
• Drazan, J. F., Phillips, W. T., Seethapathi, N., Hullfish, T. J., & Baxter, J. R. (2021). Moving outside the lab: Markerless motion capture accurately quantifies sagittal plane kinematics during the vertical jump. Journal of Biomechanics, 125, 110547. doi: https://doi.org/10.1016/j.jbiomech.2021.110547
• Fatih, G., & Vedat, A. (2023). My Jump 2 Mobil Uygulamasının Geçerlilik ve Güvenilirlik Analizi. Spor Bilimleri Araştırmaları Dergisi, 8(1), 127-135. doi: https://doi.org/10.25307/jssr.1192168
• García-Pinillos, F., Ramírez-Campillo, R., Boullosa, D., Jiménez-Reyes, P., & Latorre-Román, P. Á. (2021). Vertical jumping as a monitoring tool in endurance runners: a brief review. Journal of human kinetics, 80(1), 297-308. doi: https://doi.org/10.2478/hukin-2021-0101
• Gençoğlu, C., Ulupınar, S., Özbay, S., Turan, M., Savaş, B. Ç., Asan, S., & İnce, İ. (2023). Validity and reliability of “My Jump app” to assess vertical jump performance: a meta-analytic review. Scientific Reports, 13(1), 20137. doi: https://doi.org/10.1038/s41598-023-46935-x
• Gheller, R., Kons, R., Dal Pupo, J., & Detanico, D. (2023). Methods to calculate lower-body stretch–shortening cycle utilization in the vertical jump: Which is the best for athletes of different sports? Science & Sports, 38(5-6), 626-630. doi: https://doi.org/10.1016/j.scispo.2022.10.004
• Gonçalves, C., Baptista, R., Tufano, J., Blazevich, A. J., & Vieira, A. (2024). Error in jump height estimation using the flight time method: simulation of the effect of ankle position between takeoff and landing. PeerJ, 12, e17704. doi: https://doi.org/10.7717/peerj.17704
• İnce, İ., Ulupınar, S., Özbay, S., & Gençoğlu, C. (2021). Olimpik Halter Performansı İle Sıçrama Testleri Arasındaki İlişkiler: Bir Sistematik Derleme ve Meta-Analiz Çalışması. SPORMETRE Beden Eğitimi ve Spor Bilimleri Dergisi, 19(4), 93-108. doi: https://doi.org/10.33689/spormetre.911944
• Laurson, K. R., Baptista, F., Mahar, M. T., Welk, G. J., & Janz, K. F. (2022). Long jump, vertical jump, and vertical jump power reference curves for 10-18 year olds. Measurement in Physical Education and Exercise Science, 26(4), 306-314. doi: https://doi.org/10.1080/1091367X.2021.2017291
• MacKenzie, S. J., Lavers, R. J., & Wallace, B. B. (2014). A biomechanical comparison of the vertical jump, power clean, and jump squat. Journal of sports sciences, 32(16), 1576-1585. doi: https://doi.org/10.1080/02640414.2014.908320
• Mahar, M. T., Welk, G. J., Janz, K. F., Laurson, K., Zhu, W., & Baptista, F. (2022). Estimation of lower body muscle power from vertical jump in youth. Measurement in Physical Education and Exercise Science, 26(4), 324-334. doi: https://doi.org/10.1080/1091367X.2022.2041420
• Mijnarends, D. M., Meijers, J. M., Halfens, R. J., ter Borg, S., Luiking, Y. C., Verlaan, S., . . . Schols, J. M. (2013). Validity and reliability of tools to measure muscle mass, strength, and physical performance in community-dwelling older people: a systematic review. Journal of the American Medical Directors Association, 14(3), 170-178. doi: https://doi.org/10.1016/j.jamda.2012.10.009
• Nishiumi, D., Nishioka, T., Saito, H., Kurokawa, T., & Hirose, N. (2023). Associations of eccentric force variables during jumping and eccentric lower-limb strength with vertical jump performance: A systematic review. PloS one, 18(8), e0289631. doi: https://doi.org/10.1371/journal.pone.0289631
• Özbay, S., & Ulupınar, S. (2022). Strength-power tests are more effective when performed after exhaustive exercise in discrimination between top-elite and elite wrestlers. The Journal of Strength & Conditioning Research, 36(2), 448-454. doi: https://doi.org/10.1519/JSC.0000000000003456
• Philipp, N. M., Cabarkapa, D., Nijem, R. M., Blackburn, S. D., & Fry, A. C. (2023). Vertical jump neuromuscular performance characteristics determining on-court contribution in male and female NCAA division 1 basketball players. Sports, 11(12), 239. doi: https://doi.org/10.3390/sports11120239
• Plakoutsis, G., Zapantis, D., Panagiotopoulou, E.-M., Paraskevopoulos, E., & Papandreou, M. (2023). Validity and reliability of the portable Kforce plates system with the use of a smartphone application for measuring countermovement jump. Gait & Posture, 106, S167-S168. doi: https://doi.org/10.1016/j.gaitpost.2023.07.201
• Pueo, B., Penichet-Tomas, A., & Jimenez-Olmedo, J. M. (2020). Validity, reliability and usefulness of smartphone and kinovea motion analysis software for direct measurement of vertical jump height. Physiology & Behavior, 227, 113144. doi: https://doi.org/10.1016/j.physbeh.2020.113144
• Ramirez-Campillo, R., Andrade, D. C., Nikolaidis, P. T., Moran, J., Clemente, F. M., Chaabene, H., & Comfort, P. (2020). Effects of plyometric jump training on vertical jump height of volleyball players: a systematic review with meta-analysis of randomized-controlled trial. Journal of sports science & medicine, 19(3), 489. doi: https://doi.org/10.25932/publishup-52589
• Roy, A., & Chakraborty, S. (2023). Support vector machine in structural reliability analysis: A review. Reliability Engineering & System Safety, 233, 109126. doi: https://doi.org/10.1016/j.ress.2023.109126
• Ruiz, J. R., Castro-Piñero, J., España-Romero, V., Artero, E. G., Ortega, F. B., Cuenca, M. M., . . . Mora, J. (2011). Field-based fitness assessment in young people: the ALPHA health-related fitness test battery for children and adolescents. British journal of sports medicine, 45(6), 518-524. doi: https://doi.org/10.1136/bjsm.2010.075341
• Satkunskiene, D., Kamandulis, S., Brazaitis, M., Snieckus, A., & Skurvydas, A. (2021). Effect of high volume stretch-shortening cycle exercise on vertical leg stiffness and jump performance. Sports biomechanics, 20(1), 38-54. doi: https://doi.org/10.1080/14763141.2018.1522366
• Soares, D., Rodrigues, C., Lourenço, J., & Dias, A. (2023). Validity and Reliability of My Jump 2 App for Jump Performance in Judo Players. The Open Sports Sciences Journal, 16(1). doi: https://doi.org/10.2174/1875399X-v16-e230714-2023-6
• Ulupınar, S. (2022). Atletik Performans Ölçümlerinde Test–Tekrar Test Güvenirliği Analizleri. İstanbul Gelişim Üniversitesi Sosyal Bilimler Dergisi, 9(2), 738-747. doi: https://doi.org/10.17336/igusbd.809612
• Ulupinar, S., Özbay, S., & Gençoğlu, C. (2021). Counter movement jump and sport specific frequency speed of kick test to discriminate between elite and sub-elite kickboxers. Acta Gymnica, 50(4), 141-146. doi: https://doi.org/10.5507/ag.2020.019
• Walsh, M. S., Ford, K. R., Bangen, K. J., Myer, G. D., & Hewett, T. E. (2006). The validation of a portable force plate for measuring force-time data during jumping and landing tasks. Journal of Strength and Conditioning Research, 20(4), 730.
• Živanović, V. (2022). The effects of different conditioning contraction protocols of post-activation performance enhancement on variables of eccentric phases and concentric phase of vertical jumps. Journal of Physical Education and Sport, 22(7), 1694-1707. doi: https://doi.org/10.7752/jpes.2022.07213