Evaluating the Readability and Quality of Influenza Vaccine- Related Websites

Year 2025, Volume: 55 Issue: 3, 480 - 485, 14.01.2026

Nazlıcan Uçar Yaman , Humeysa Kiyak-kırmacı

https://doi.org/10.26650/IstanbulJPharm.2025.1742131

https://izlik.org/JA26YE58YS

Abstract

Background and Aims: The Internet is one of the most commonly used sources for health-related information. However, low health literacy and the complexity of online content can hinder individuals’ understanding and acceptance of the influenza vaccine. This study aimed to evaluate the readability and quality of the information on influenza vaccine-related on Turkish websites.

Methods: Forty-nine websites were included in this cross-sectional study, which was conducted in October 2024. These websites were evaluated according to readability (Ateşman and Bezirci-Yılmaz readability formulas), quality (HONcode and DISCERN scores), and the academic affiliation of the website founders and their origin.

Results: The majority of the 49 websites (77.6%) belonged to hospitals or official organisations. The mean of the quality score of the sites according to the HONcode criteria is 5.51±1.81, while according to DISCERN it is 47.85±8.88. Accordingly, the Ateşman readability level of information about the influenza vaccine was found to be at the 11th-12th grade education level and the Bezirci-Yılmaz readability level was found to be at the undergraduate level. No significant difference was found between the groups in terms of readability or quality of content in the classifications made according to the origin or academic affiliation (p > 0.05).

Conclusion: The readability and quality of Turkish websites need to be improved to determine the needs of people with poor literacy skills regarding influenza vaccination and to meet these needs.

Keywords

Health Literacy , Quality , Readability , Vaccine , Website

References

• Ateşman, E. (1997). Measurement of readability in Turkish. Language Journal, 58, 71-74. google scholar
• Balakrishnan, V., Chandy, Z., Hseih, A., Bui, T. L., & Verma, S. P. (2016). Readability and Understandability of Online Vocal Cord Paralysis Materials. Otolaryngology and Head and Neck Surgery, 154(3), 460-464, https://doi.org/10.1177/0194599815626146. google scholar
• Berkman, N. D., DeWalt, D. A., Pignone, M. P., Sheridan, S. L., Lohr, K. N., Lux, L., et al. (2004). Literacy and health outcomes: summary. AHRQ evidence report summaries. google scholar
• Bezirci, B., & Yılmaz, A. E. (2010). A software library for measurement of readability of texts and a new readability metric for Turkish. DEÜ FMD, 12(3), 49-62. google scholar
• Charnock, D. (1998). The DISCERN handbook. Quality criteria for consumer health information on treatment choices. Radcliffe: University of Oxford and The British Library, 7-51. google scholar
• Charnock, D., Shepperd, S., Needham, G., & Gann, R. (1999). DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. Journal of Epidemiology and Community Health, 53(2), 105-111, https://doi.org/10.1136/jech.53.2.105. google scholar
• Cinar, I. (2019). Study of the Quality of Website Information Related to Promotion of Pathology. google scholar
• Demirci, A. N., İncebay, Ö., & Köse, A. (2024). Evaluation of quality and readability of internet information on voice disorders. Public health, 226, 1-7, https://doi. org/https://doi.org/10.1016/j.puhe.2023.10.020. google scholar
• Dueppen, A. J., Bellon-Harn, M. L., Radhakrishnan, N., & Manchaiah, V. (2019). Quality and readability of English-language Internet information for voice disorders. Journal of Voice, 33(3), 290-296, https://doi.org/10.1016/j.jvoice.2017.11.002. google scholar
• Er, A., Ay, I. E., & Horozoğlu Ceran, T. (2024). Evaluating Turkish Readability and Quality of Strabismus-Related Websites. Cureus, 16(4), e58603, https://doi.org/ 10.7759/cureus.58603. google scholar
• Felgendreff, L., Rebitschek, F. G., Shamsrizi, P., Geiger, M., Jenny, M. A., & Betsch, C. (2025). Explaining seasonality increases perceived effectiveness of influenza vaccination: An experimental study. Br J Health Psychol, 30(1), https://doi.org/ 10.1111/bjhp.12770. google scholar
• Flesch, R. (1948). A new readability yardstick. Journal of Applied Psychology, 32(3), 221, https://doi.org/10.1037/h0057532. google scholar
• Gao, S., Li, Y., Wang, X., Li, S., Chen, M., & Yue, B. (2024). Vaccine literacy, vaccination intention, and their correlation among adults in Mainland China: a crosssectional study. J Health Popul Nutr, 43(1), 122, https://doi.org/10.1186/s41043-024-00602-7. google scholar
• Kaicker, J., Borg Debono, V., Dang, W., Buckley, N., & Thabane, L. (2010). Assessment of the quality and variability of health information on chronic pain websites using the DISCERN instrument. BMC Medicine, 8(1), 59, https://doi.org/10.1186/ 1741-7015-8-59. google scholar
• Kara, A. (2019). Evaluation of the readability of online texts related with autism spectrum disorder. Experimental Biomedical Research, 2(4), 136, https://doi. org/10.30714/j-ebr.2019454841. google scholar
• Laçiner, K., & Şenol, Y. (2023). How Easy Is It to Read Websites About Schizophrenia? Cureus, 15(11), e48790, https://doi.org/10.7759/cureus.48790. google scholar
• Misra, P., Kasabwala, K., Agarwal, N., Eloy, J. A., & Liu, J. K. (2012). Readability analysis of internet-based patient information regarding skull base tumors. Journal of Neuro-Oncology, 109(3), 573-580, https://doi.org/10.1007/s11060-012-0930-4. google scholar
• Mulvihill, C., O’Donoghue, G., & Pierse, D. (2022). Quality assessment and review of online information relating to third molar pain and removal. Journal of the Irish Dental Association, 68(5, October/November), https://doi.org/10.58541/ 001c.67922. google scholar
• Okuhara, T., Ishikawa, H., Okada, M., Kato, M., & Kiuchi, T. (2017). A readability comparison of anti- versus pro-influenza vaccination online messages in Japan. Preventive Medicine Reports, 6, 47-52, https://doi.org/https://doi.org/10.1016/ j.pmedr.2017.02.013. google scholar
• Okuhara, T., Ishikawa, H., Ueno, H., Okada, H., Kato, M., & Kiuchi, T. (2022). Readability assessment of vaccine information: A systematic review for addressing vaccine hesitancy. Patient Education and Counseling, 105(2), 331-338, https://doi.org/ 10.1016/j.pec.2021.05.039. google scholar
• Şenoymak, İ., & Şenoymak, M. C. (2024). Assessing the readability of diabetes information provided by the Turkish Ministry of Health. Anatolian Current Medical Journal, 6(6), 367-371, https://doi.org/10.38053/acmj.1520237. google scholar
• Similarweb. (2024, October). Search engines market share in Turkey. Retrieved from https://www.similarweb.com/engines/turkey/. google scholar
• Solak, İ., Kozanhan, B., & Ay, E. (2021). Readability of Turkish Websites Containing COVID-19 Information. anatol j fm, 4(1), 57-62, https://doi.org/10.5505/ anatoljfm.2020.21939. google scholar
• Turan Dizdar, H., Kent, A., & Işık, İ. (2024). Tinnitus ile İlgili Türkçe İnternet Materyallerinin Kalitesi ve Okunabilirliği: Kesitsel Araştırma [Quality and Readability of Turkish Language Internet Materials About Tinnitus: Cross-Sectional Research]. Türkiye Klinikleri Sağlık Bilimleri Dergisi, 9(3), https://doi.org/10.5336/ healthsci.2024-101707. google scholar
• Turkish Statistical Institute. (2024, May 30). National education statistics, 2023. https://data.tuik.gov.tr/Bulten/Index?p=National-Education-Statistics-2023-53444 google scholar
• Wang, L. W., Miller, M. J., Schmitt, M. R., & Wen, F. K. (2013). Assessing readability formula differences with written health information materials: application, results, and recommendations. Res Social Adm Pharm, 9(5), 503-516, https:// doi.org/10.1016/j.sapharm.2012.05.009. google scholar
• World Health Organization. (2022). Health literacy development for the prevention and control of noncommunicable diseases: Volume 4. Case studies from WHO National Health Literacy Demonstration Projects. Geneva, Switzerland: World Health Organization. google scholar
• World Health Organization. (2024). Health literacy. Retrieved from https://www.who. int/news-room/fact-sheets/detail/health-literacy. google scholar
• Yaran, M., & Özkan, E. (2022). Ergoterapi ile İlgili Çevrimiçi Bilgilerin Kalitesi ve Okunabilirliği [Quality and Readability of Occupational Therapy-Related Online Information]. Ergoterapi ve Rehabilitasyon Dergisi, 10(2), 45-52, https://doi.org/10.30720/ered.904799. google scholar
• Yilmaz, R., Karpuz, S., Gokpinar, H. H., & Yilmaz, H. (2022). Evaluating the information content, readability, and reliability of turkish websites about fibromyalgia. Medical Bulletin of Haseki/Haseki Tip Bulteni, 60, 425-432, https://doi.org/10.4274/haseki.galenos.2022.8737. google scholar