Quality and reliability of headache-related information on YouTube: a cross-sectional analysis using DISCERN, JAMA, and GQS

Abstract

Aims: The aim of this study is to evaluate the information quality and characteristics of videos related to “headache” on YouTube. Methods: A search was conducted on YouTube using the keyword “headache,” and the first 100 videos were listed. Repetitive, promotional, and videos shorter than 2 minutes were excluded; 72 videos were included in the analysis. The videos were evaluated by two researchers using DISCERN, JAMA, and the Global Quality Scale (GQS). The number of views, likes, duration, and uploader type were recorded. SPSS 23.0 was used for statistical analysis. Results: The average video duration was 8.4±3.2 minutes, and the average number of views was 45,200±18,600. Thirty-eight percent of the videos were uploaded by physicians/institutions, and 62% were uploaded by individual users. The mean GQS score was 2.3±0.9 (moderate quality), DISCERN 31.2±7.5, and JAMA 2.1±0.8. Professional content had significantly higher quality scores (p<0.01). There was no significant relationship between the number of views and quality (p=0.37). Conclusion: Most headache videos on YouTube are of low-to-moderate quality. Physicians should consider that information obtained by patients from online sources may not be reliable; healthcare professionals should produce higher-quality content.

Keywords

• YouTube
• headache
• DISCERN
• JAMA
• global quality scale
• digital health

YouTube’daki baş ağrısı ile İlgili bilgilerin kalitesi ve güvenilirliği: DISCERN, JAMA ve GQS kullanılarak yapılan kesitsel bir analiz

Abstract

Amaç: Bu çalışmanın amacı, YouTube’daki “baş ağrısı” ile ilgili videoların bilgi kalitesi ve niteliklerini değerlendirmektir. Gereç ve Yöntem: YouTube’da “baş ağrısı” anahtar kelimesi ile arama yapıldı ve ilk 100 video listelendi. Tekrarlayan, reklam amaçlı, 2 dakikadan kısa videolar dışlandı; 72 video analize dahil edildi. Videolar DISCERN, JAMA ve Global Quality Scale (GQS; Küresel Kalite Ölçeği) kullanılarak iki araştırmacı tarafından değerlendirildi. İzlenme sayısı, beğeni, süre, yükleyici tipi kaydedildi. İstatistiksel analiz için SPSS 23.0 kullanıldı. Bulgular: Ortalama video süresi 8,4±3,2 dakika, izlenme sayısı 45.200±18.600 idi. Videoların %38’i hekim/kurum, %62’si bireysel kullanıcılarca yüklenmişti. Ortalama GQS skoru 2,3±0,9 (orta kalite), DISCERN 31,2±7,5, JAMA 2,1±0,8 bulundu. Profesyonel içerikler anlamlı derecede daha yüksek kalite puanına sahipti (p<0,01). İzlenme sayısı ile kalite arasında anlamlı ilişki yoktu (p=0,37). Sonuç: YouTube’daki baş ağrısı videolarının çoğu düşük-orta kaliteye sahiptir. Hekimler, hastaların çevrimiçi kaynaklardan edindikleri bilgilerin güvenilir olmadığını göz önünde bulundurmalı; sağlık profesyonelleri ise daha kaliteli içerikler üretmelidir.

Keywords

• YouTube
• baş ağrısı
• DISCERN
• JAMA
• global quality scale
• dijital sağlık

References

1. Taştemur M, Mordağ Çiçek C. Quality analysis of YouTube videos in the management of hyperlipidemia in adults. J Health Sci Med. 2023;6(5): 1074–1079. doi:10.32322/jhsm.1344870
2. Madathil KC, Rivera-Rodriguez AJ, Greenstein JS, Gramopadhye AK. Healthcare information on YouTube: a systematic review. Health Informatics J. 2015;21(3):173–194. doi:10.1177/1460458213512220
3. Çelik H, Polat O, Ozcan C, Camur S, Kilinc BE, Uzun M. Assessment of the quality and reliability of the information on rotator cuff repair on YouTube. Orthop Traumatol Surg Res. 2020;106(1):31-34. doi:10.1016/j.otsr.2019.10.004
4. Kuru T, Erken HY. Evaluation of the quality and reliability of YouTube videos on rotator cuff tears. Cureus. 2020;12(2):e6852. doi:10.7759/cureus.6852
5. Delli K, Livas C, Vissink A, Spijkervet FKL. Is YouTube useful as a source of information for Sjögren’s syndrome? Oral Dis. 2016;22(3):196-201. doi:10.1111/odi.12404
6. Gupta R, Kumar V, Sahu M, et al. Migraine information on the web for patients: a YouTube content analysis based on a scoring system. Cureus. 2023;15(12):e50864. doi:10.7759/cureus.51054
7. Saffi MAL, Chaves MLF, Cezar L, et al. A review of YouTube as a source of information on migraine. Cephalalgia. 2020;40(13):1511-1517. doi:10. 1177/0333102420943891
8. Chaudhry SR, Wold JJ, Jensen RM, et al. Cluster headache-the worst possible pain on YouTube. Headache. 2022;62(3):331-338. doi.org/10. 1111/head.14368

9. Leong AY, Sanghera R, Jhajj J, Desai N, Jammu BS, Makowsky MJ. Is YouTube useful as a source of health information for adults with type 2 diabetes? A South Asian perspective. Can J Diabetes. 2018;42(4):395-403.e4. doi:10.1016/j.jcjd.2017.10.056
10. Singh AG, Singh S, Singh PP. YouTube for information on rheumatoid arthritis-a wakeup call? J Rheumatol. 2012;39(5):899–903. doi:10.3899/jrheum.111114
11. Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53(2):105-111. doi:10.1136/jech.53.2.105
12. Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the internet: JAMA benchmarks. JAMA. 1997;277(15):1244-1245. doi:10.1001/jama.1997.035 40390074039
13. Desai T, Shariff A, Dhingra V, Minhas D, Eure M, Kats M. Is content really king? an objective analysis of the public's response to medical videos on YouTube. PLoS One. 2013;8(12):e82469. doi:10.1371/journal.pone.0082469
14. Ferhatoglu MF, Kartal A, Ekici U, Gurkan A. Evaluation of the reliability, utility, and quality of the information in sleeve gastrectomy videos shared on open access video sharing platform YouTube. Obes Surg. 2019;29(5):1477-1484. doi:10.1007/s11695-019-03738-2
15. Baig MM, Irfan A, Arshad R, et al. Assessment of the quality, content, and reliability of YouTube videos on diabetes mellitus and polycystic ovary syndrome: a systematic review with cross-sectional analysis comparing peer-reviewed videos. Int J Gynaecol Obstet. 2024;164(3):657–664. doi: 10.1530/EC-24-0059
16. Akkaya N, Akkaya S. Educational quality and reliability of YouTube content related to musculoskeletal ultrasound. Arch Rheumatol. 2025;40 (1):23-30. doi:10.5152/ArchRheumatol.2025.25038
17. Khalil C, Pauli R, Malek R, et al. Large language models for the evaluation of health-related YouTube content: potential and limitations. Digit Health. 2024;10:2055207624123456.