Evaluation of the Reliability and Quality of YouTube Videos about Insulin Injection in Children

Year 2024, Issue: Early Access

Banu Turhan

https://doi.org/10.18678/dtfd.1534059

Abstract

Aim: Social media platforms, especially YouTube, have become indispensable channels where patients apply for information on medical issues. This study aimed to evaluate the reliability and quality of videos on YouTube about insulin injection in children.
Material and Methods: The first 100 videos with the search “insulin injection in children” were analyzed. The distribution of video types, viewing rates, like ratios, number of comments, and video power indexes (VPI) were recorded. The content qualities were assessed by the global quality scale (GQS), modified DISCERN score, the Journal of the American Medical Association (JAMA) benchmark score, and the patient education materials assessment tool for audio/visual (PEMAT-A/V) materials.
Results: Forty-seven (47%) videos were analyzed finally. The median score of the GQS was 4, modified DISCERN and JAMA was 3. The median PEMAT A/V understandability and actionability scores were 84 and 75. Videos by professionals were found to have better results than the non-professional (p<0.001). Correlation analyses revealed positive correlations between video analytics, such as number of views, likes and comments, view rate, VPI, and content quality scales, including GQS, modified DISCERN, JAMA, and PEMAT-A/V scores (p<0.001).
Conclusion: Although many of the videos examined were of professional origin and their quality scores were higher, the rate of videos from non-professional origin was close to half. The quality scores of these non-professional videos were quite low in all used scales. It is important that patients and their relatives prefer videos uploaded by professional sources to access information from platforms such as YouTube.

Keywords

Diabetes mellitus, insulin injection, child, YouTube

Çocuklarda İnsülin Enjeksiyonu ile İlgili YouTube Videolarının Güvenilirliği ve Kalitesinin Değerlendirilmesi

Abstract

Amaç: Başta YouTube olmak üzere sosyal medya platformları, hastaların tıbbi konularda bilgi almak için başvurdukları vazgeçilmez mecralar haline gelmiştir. Bu çalışma, çocuklarda insülin enjeksiyonu ile ilgili YouTube videolarının güvenilirliğini ve kalitesini değerlendirmeyi amaçlamaktadır.
Gereç ve Yöntemler: “Çocuklarda insülin enjeksiyonu” aramasını içeren ilk 100 video analiz edilmiştir. Video türlerinin dağılımı, izlenme oranları, beğenilme oranları, yorum sayıları ve video güç endeksleri (video power index, VPI) kaydedilmiştir. İçerik kaliteleri küresel kalite ölçeği (global quality scale, GQS), modifiye DISCERN skoru, Journal of the American Medical Association (JAMA) kıyaslama skoru ve görsel/işitsel materyaller için hasta eğitim materyalleri değerlendirme aracı (patient education materials assessment tool for audio/visual, PEMAT-A/V) ile değerlendirilmiştir.
Bulgular: Çalışmada 47 (%47) video analiz edilmiştir. GQS puanı ortancası 4, modifiye edilmiş DISCERN ve JAMA 3 idi. Ortanca PEMAT A/V anlaşılabilirlik ve eyleme geçirilebilirlik puanları ise 84 ve 75 idi. Profesyoneller tarafından yüklenen videoların profesyonel olmayanlara göre daha iyi sonuçlara sahip olduğu görülmüştür (p<0,001). Korelasyon analizi, görüntülenme, beğeni ve yorum sayısı, görüntüleme oranı, VPI gibi video analitikleri ile GQS, modifiye DISCERN, JAMA ve PEMAT-A/V puanlarını içeren içerik kalitesi arasında pozitif korelasyonlar olduğu göstermiştir (p<0,001).
Sonuç: İncelenen videoların birçoğu profesyonel kaynaklı olmasına ve kalite puanları daha yüksek olmasına rağmen, profesyonel olmayan kaynaklı videoların oranının yarıya yakın olduğu gözlenmiştir. Profesyonel olmayan bu videoların kalite puanlarının da kullanılan tüm ölçeklerde oldukça düşük olduğu tespit edilmiştir. Hasta ve hasta yakınlarının YouTube gibi platformlardan bilgiye ulaşmak için profesyonel kaynaklar tarafından yüklenen videoları tercih etmeleri önemlidir.

Keywords

Diabetes mellitus, insülin enjeksiyonu, çocuk, YouTube

References

• Zuberi Z, Sauli E, Cun L, Deng J, Li WJ, He XL, et al. Insulin-delivery methods for children and adolescents with type 1 diabetes. Ther Adv Endocrinol Metab. 2020;11:2042018820906016.
• Neu A, Bürger-Büsing J, Danne T, Dost A, Holder M, Holl RW, et al. Diagnosis, therapy and follow-up of diabetes mellitus in children and adolescents. Exp Clin Endocrinol Diabetes. 2019;127(S 01):S39-72.
• Bangstad HJ, Danne T, Deeb LC, Jarosz-Chobot P, Urakami T, Hanas R; International Society for Pediatric and Adolescent Diabetes. ISPAD clinical practice consensus guidelines 2006-2007. Insulin treatment. Pediatr Diabetes. 2007;8(2):88-102.
• Diabetes Control and Complications Trial Research Group; Nathan DM, Genuth S, Lachin J, Cleary P, Crofford O, Davis M, et al. The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med. 1993;329(14):977-86.
• Shah VN, Moser EG, Blau A, Dhingra M, Garg SK. The future of basal insulin. Diabetes Technol Ther. 2013;15(9):727-32.
• Shah RB, Patel M, Maahs DM, Shah VN. Insulin delivery methods: Past, present and future. Int J Pharm Investig. 2016;6(1):1-9.
• Olsen BS, Lilleøre SK, Korsholm CN, Kracht T. Novopen Echo® for the delivery of insulin: a comparison of usability, functionality and preference among pediatric subjects, their parents, and health care professionals. J Diabetes Sci Technol. 2010;4(6):1468-75.
• Hanas R, de Beaufort C, Hoey H, Anderson B. Insulin delivery by injection in children and adolescents with diabetes. Pediatr Diabetes. 2011;12(5):518-26.
• Madathil KC, Rivera-Rodriguez AJ, Greenstein JS, Gramopadhye AK. Healthcare information on YouTube: A systematic review. Health Informatics J. 2015;21(3):173-94.
• Statista.com [Internet]. Most popular websites worldwide as of November 2023, by unique visitors. [Cited: 2024 October 24]. Available from: https://www.statista.com/statistics/1201889/most-visited-websites-worldwide-unique-visits/.
• Osman W, Mohamed F, Elhassan M, Shoufan A. Is YouTube a reliable source of health-related information? A systematic review. BMC Med Educ. 2022;22(1):382.
• Sui W, Sui A, Rhodes RE. What to watch: Practical considerations and strategies for using YouTube for research. Digit Health. 2022;8:20552076221123707.
• Barlas T, Ecem Avci D, Cinici B, Ozkilicaslan H, Muhittin Yalcin M, Eroglu Altinova A. The quality and reliability analysis of YouTube videos about insulin resistance. Int J Med Inform. 2023;170:104960.
• Gülhan Güner S, Tezel M, Özsaban A. The content, reliability, and quality of insulin pen injection videos on YouTube as patient education resource. Comput Inform Nurs. 2024;42(11):809-16.
• Urman A, Makhortykh M. You are how (and where) you search? Comparative analysis of web search behavior using web tracking data. J Comput Soc Sci. 2023;6(2):1-16.
• Srinivasacharlu A. Using YouTube in colleges of education. Shanlax Int J Educ. 2020;8(2):21-4.
• Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53(2):105-11.
• Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor--Let the reader and viewer beware. JAMA. 1997;277(15):1244-5.
• Drozd B, Couvillon E, Suarez A. Medical YouTube videos and methods of evaluation: literature review. JMIR Med Educ. 2018;4(1):e3.
• Gurler D, Buyukceran I. Assessment of the medical reliability of videos on social media: detailed analysis of the quality and usability of four social media platforms (Facebook, Instagram, Twitter, and YouTube). Healthcare (Basel). 2022;10(10):1836.
• Shoemaker SJ, Wolf MS, Brach C. Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information. Patient Educ Couns. 2014;96(3):395-403.
• Kong W, Song S, Zhao YC, Zhu Q, Sha L. TikTok as a health information source: assessment of the quality of information in diabetes-related videos. J Med Internet Res. 2021;23(9):e30409.
• Gimenez-Perez G, Robert-Vila N, Tomé-Guerreiro M, Castells I, Mauricio D. Are YouTube videos useful for patient self-education in type 2 diabetes? Health Informatics J. 2020;26(1):45-55.
• Mylavarapu M, Maheta D, Clarke S, Parmar K, Mohammed M, Vuyyuru CS. Diabetes mellitus on YouTube: A cross-sectional observational study to assess the quality and reliability of videos. Cureus. 2023;15(8):e43704.
• Danne T, Phillip M, Buckingham BA, Jarosz-Chobot P, Saboo B, Urakami T, et al. ISPAD Clinical Practice Consensus Guidelines 2018: Insulin treatment in children and adolescents with diabetes. Pediatr Diabetes. 2018;19(Suppl 27):115-35.
• White NH, Sun W, Cleary PA, Danis RP, Davis MD, Hainsworth DP, et al. Prolonged effect of intensive therapy on the risk of retinopathy complications in patients with type 1 diabetes mellitus: 10 years after the Diabetes Control and Complications Trial. Arch Ophthalmol. 2008;126(12):1707-15.
• El-Jawahri A, Paasche-Orlow MK, Matlock D, Stevenson LW, Lewis EF, Stewart G, et al. Randomized, controlled trial of an advance care planning video decision support tool for patients with advanced heart failure. Circulation. 2016;134(1):52-60.
• Desai T, Shariff A, Dhingra V, Minhas D, Eure M, Kats M. Is content really king? An objective analysis of the public's response to medical videos on YouTube. PLoS One. 2013;8(12):e82469.
• Şahin A, Şahin M, Türkcü FM. YouTube as a source of information in retinopathy of prematurity. Ir J Med Sci. 2019;188(2):613-7.
• Ozsoy-Unubol T, Alanbay-Yagci E. YouTube as a source of information on fibromyalgia. Int J Rheum Dis. 2021;24(2):197-202.
• De La Torre AB, Joe S, Lee VS. An evaluation of YouTube videos as a surgical instructional tool for endoscopic endonasal approaches in otolaryngology. Ear Nose Throat J. 2024;103(7):NP440-9.
• Altun A, Askin A, Sengul I, Aghazada N, Aydin Y. Evaluation of YouTube videos as sources of information about complex regional pain syndrome. Korean J Pain. 2022;35(3):319-26.
• Özcan F, Gürçay E. Is the information about lateral epicondylitis on the YouTube platform reliable and of good quality? Phys Sportsmed. 2023;51(5):458-62.