Evaluating the Readability and Quality of Influenza Vaccine- Related Websites

Nazlıcan Uçar Yaman; Humeysa Kiyak-kırmacı

doi:10.26650/IstanbulJPharm.2025.1742131

Evaluating the Readability and Quality of Influenza Vaccine- Related Websites

Abstract

Background and Aims: The Internet is one of the most commonly used sources for health-related information. However, low health literacy and the complexity of online content can hinder individuals’ understanding and acceptance of the influenza vaccine. This study aimed to evaluate the readability and quality of the information on influenza vaccine-related on Turkish websites. Methods: Forty-nine websites were included in this cross-sectional study, which was conducted in October 2024. These websites were evaluated according to readability (Ateşman and Bezirci-Yılmaz readability formulas), quality (HONcode and DISCERN scores), and the academic affiliation of the website founders and their origin. Results: The majority of the 49 websites (77.6%) belonged to hospitals or official organisations. The mean of the quality score of the sites according to the HONcode criteria is 5.51±1.81, while according to DISCERN it is 47.85±8.88. Accordingly, the Ateşman readability level of information about the influenza vaccine was found to be at the 11th-12th grade education level and the Bezirci-Yılmaz readability level was found to be at the undergraduate level. No significant difference was found between the groups in terms of readability or quality of content in the classifications made according to the origin or academic affiliation (p > 0.05). Conclusion: The readability and quality of Turkish websites need to be improved to determine the needs of people with poor literacy skills regarding influenza vaccination and to meet these needs.

Keywords

References

Ateşman, E. (1997). Measurement of readability in Turkish. Language Journal, 58, 71-74. google scholar
Balakrishnan, V., Chandy, Z., Hseih, A., Bui, T. L., & Verma, S. P. (2016). Readability and Understandability of Online Vocal Cord Paralysis Materials. Otolaryngology and Head and Neck Surgery, 154(3), 460-464, https://doi.org/10.1177/0194599815626146. google scholar
Berkman, N. D., DeWalt, D. A., Pignone, M. P., Sheridan, S. L., Lohr, K. N., Lux, L., et al. (2004). Literacy and health outcomes: summary. AHRQ evidence report summaries. google scholar
Bezirci, B., & Yılmaz, A. E. (2010). A software library for measurement of readability of texts and a new readability metric for Turkish. DEÜ FMD, 12(3), 49-62. google scholar
Charnock, D. (1998). The DISCERN handbook. Quality criteria for consumer health information on treatment choices. Radcliffe: University of Oxford and The British Library, 7-51. google scholar
Charnock, D., Shepperd, S., Needham, G., & Gann, R. (1999). DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. Journal of Epidemiology and Community Health, 53(2), 105-111, https://doi.org/10.1136/jech.53.2.105. google scholar
Cinar, I. (2019). Study of the Quality of Website Information Related to Promotion of Pathology. google scholar
Demirci, A. N., İncebay, Ö., & Köse, A. (2024). Evaluation of quality and readability of internet information on voice disorders. Public health, 226, 1-7, https://doi. org/https://doi.org/10.1016/j.puhe.2023.10.020. google scholar

Dueppen, A. J., Bellon-Harn, M. L., Radhakrishnan, N., & Manchaiah, V. (2019). Quality and readability of English-language Internet information for voice disorders. Journal of Voice, 33(3), 290-296, https://doi.org/10.1016/j.jvoice.2017.11.002. google scholar
Er, A., Ay, I. E., & Horozoğlu Ceran, T. (2024). Evaluating Turkish Readability and Quality of Strabismus-Related Websites. Cureus, 16(4), e58603, https://doi.org/ 10.7759/cureus.58603. google scholar
Felgendreff, L., Rebitschek, F. G., Shamsrizi, P., Geiger, M., Jenny, M. A., & Betsch, C. (2025). Explaining seasonality increases perceived effectiveness of influenza vaccination: An experimental study. Br J Health Psychol, 30(1), https://doi.org/ 10.1111/bjhp.12770. google scholar
Flesch, R. (1948). A new readability yardstick. Journal of Applied Psychology, 32(3), 221, https://doi.org/10.1037/h0057532. google scholar
Gao, S., Li, Y., Wang, X., Li, S., Chen, M., & Yue, B. (2024). Vaccine literacy, vaccination intention, and their correlation among adults in Mainland China: a crosssectional study. J Health Popul Nutr, 43(1), 122, https://doi.org/10.1186/s41043-024-00602-7. google scholar
Kaicker, J., Borg Debono, V., Dang, W., Buckley, N., & Thabane, L. (2010). Assessment of the quality and variability of health information on chronic pain websites using the DISCERN instrument. BMC Medicine, 8(1), 59, https://doi.org/10.1186/ 1741-7015-8-59. google scholar
Kara, A. (2019). Evaluation of the readability of online texts related with autism spectrum disorder. Experimental Biomedical Research, 2(4), 136, https://doi. org/10.30714/j-ebr.2019454841. google scholar
Laçiner, K., & Şenol, Y. (2023). How Easy Is It to Read Websites About Schizophrenia? Cureus, 15(11), e48790, https://doi.org/10.7759/cureus.48790. google scholar
Misra, P., Kasabwala, K., Agarwal, N., Eloy, J. A., & Liu, J. K. (2012). Readability analysis of internet-based patient information regarding skull base tumors. Journal of Neuro-Oncology, 109(3), 573-580, https://doi.org/10.1007/s11060-012-0930-4. google scholar
Mulvihill, C., O’Donoghue, G., & Pierse, D. (2022). Quality assessment and review of online information relating to third molar pain and removal. Journal of the Irish Dental Association, 68(5, October/November), https://doi.org/10.58541/ 001c.67922. google scholar
Okuhara, T., Ishikawa, H., Okada, M., Kato, M., & Kiuchi, T. (2017). A readability comparison of anti- versus pro-influenza vaccination online messages in Japan. Preventive Medicine Reports, 6, 47-52, https://doi.org/https://doi.org/10.1016/ j.pmedr.2017.02.013. google scholar
Okuhara, T., Ishikawa, H., Ueno, H., Okada, H., Kato, M., & Kiuchi, T. (2022). Readability assessment of vaccine information: A systematic review for addressing vaccine hesitancy. Patient Education and Counseling, 105(2), 331-338, https://doi.org/ 10.1016/j.pec.2021.05.039. google scholar
Şenoymak, İ., & Şenoymak, M. C. (2024). Assessing the readability of diabetes information provided by the Turkish Ministry of Health. Anatolian Current Medical Journal, 6(6), 367-371, https://doi.org/10.38053/acmj.1520237. google scholar
Similarweb. (2024, October). Search engines market share in Turkey. Retrieved from https://www.similarweb.com/engines/turkey/. google scholar
Solak, İ., Kozanhan, B., & Ay, E. (2021). Readability of Turkish Websites Containing COVID-19 Information. anatol j fm, 4(1), 57-62, https://doi.org/10.5505/ anatoljfm.2020.21939. google scholar
Turan Dizdar, H., Kent, A., & Işık, İ. (2024). Tinnitus ile İlgili Türkçe İnternet Materyallerinin Kalitesi ve Okunabilirliği: Kesitsel Araştırma [Quality and Readability of Turkish Language Internet Materials About Tinnitus: Cross-Sectional Research]. Türkiye Klinikleri Sağlık Bilimleri Dergisi, 9(3), https://doi.org/10.5336/ healthsci.2024-101707. google scholar
Turkish Statistical Institute. (2024, May 30). National education statistics, 2023. https://data.tuik.gov.tr/Bulten/Index?p=National-Education-Statistics-2023-53444 google scholar
Wang, L. W., Miller, M. J., Schmitt, M. R., & Wen, F. K. (2013). Assessing readability formula differences with written health information materials: application, results, and recommendations. Res Social Adm Pharm, 9(5), 503-516, https:// doi.org/10.1016/j.sapharm.2012.05.009. google scholar
World Health Organization. (2022). Health literacy development for the prevention and control of noncommunicable diseases: Volume 4. Case studies from WHO National Health Literacy Demonstration Projects. Geneva, Switzerland: World Health Organization. google scholar
World Health Organization. (2024). Health literacy. Retrieved from https://www.who. int/news-room/fact-sheets/detail/health-literacy. google scholar
Yaran, M., & Özkan, E. (2022). Ergoterapi ile İlgili Çevrimiçi Bilgilerin Kalitesi ve Okunabilirliği [Quality and Readability of Occupational Therapy-Related Online Information]. Ergoterapi ve Rehabilitasyon Dergisi, 10(2), 45-52, https://doi.org/10.30720/ered.904799. google scholar
Yilmaz, R., Karpuz, S., Gokpinar, H. H., & Yilmaz, H. (2022). Evaluating the information content, readability, and reliability of turkish websites about fibromyalgia. Medical Bulletin of Haseki/Haseki Tip Bulteni, 60, 425-432, https://doi.org/10.4274/haseki.galenos.2022.8737. google scholar

Details

Primary Language

English

Subjects

Clinical Pharmacy and Pharmacy Practice

Journal Section

Research Article

Authors

Nazlıcan Uçar Yaman ^*
0000-0002-6128-2801
Türkiye

Humeysa Kiyak-kırmacı
0000-0003-2574-4762
Türkiye

Publication Date

January 14, 2026

Submission Date

August 16, 2025

Acceptance Date

November 17, 2025

Published in Issue

Year 2025 Volume: 55 Number: 3

DOI

https://doi.org/10.26650/IstanbulJPharm.2025.1742131

IZ

https://izlik.org/JA26YE58YS

Cite

RIS / Bibtex

APA

Uçar Yaman, N., & Kiyak-kırmacı, H. (2026). Evaluating the Readability and Quality of Influenza Vaccine- Related Websites. İstanbul Journal of Pharmacy, 55(3), 480-485. https://doi.org/10.26650/IstanbulJPharm.2025.1742131

AMA

1.Uçar Yaman N, Kiyak-kırmacı H. Evaluating the Readability and Quality of Influenza Vaccine- Related Websites. iujp. 2026;55(3):480-485. doi:10.26650/IstanbulJPharm.2025.1742131

Chicago

Uçar Yaman, Nazlıcan, and Humeysa Kiyak-kırmacı. 2026. “Evaluating the Readability and Quality of Influenza Vaccine- Related Websites”. İstanbul Journal of Pharmacy 55 (3): 480-85. https://doi.org/10.26650/IstanbulJPharm.2025.1742131.

EndNote

Uçar Yaman N, Kiyak-kırmacı H (January 1, 2026) Evaluating the Readability and Quality of Influenza Vaccine- Related Websites. İstanbul Journal of Pharmacy 55 3 480–485.

IEEE

[1]N. Uçar Yaman and H. Kiyak-kırmacı, “Evaluating the Readability and Quality of Influenza Vaccine- Related Websites”, iujp, vol. 55, no. 3, pp. 480–485, Jan. 2026, doi: 10.26650/IstanbulJPharm.2025.1742131.

ISNAD

Uçar Yaman, Nazlıcan - Kiyak-kırmacı, Humeysa. “Evaluating the Readability and Quality of Influenza Vaccine- Related Websites”. İstanbul Journal of Pharmacy 55/3 (January 1, 2026): 480-485. https://doi.org/10.26650/IstanbulJPharm.2025.1742131.

JAMA

1.Uçar Yaman N, Kiyak-kırmacı H. Evaluating the Readability and Quality of Influenza Vaccine- Related Websites. iujp. 2026;55:480–485.

MLA

Uçar Yaman, Nazlıcan, and Humeysa Kiyak-kırmacı. “Evaluating the Readability and Quality of Influenza Vaccine- Related Websites”. İstanbul Journal of Pharmacy, vol. 55, no. 3, Jan. 2026, pp. 480-5, doi:10.26650/IstanbulJPharm.2025.1742131.

Vancouver

1.Nazlıcan Uçar Yaman, Humeysa Kiyak-kırmacı. Evaluating the Readability and Quality of Influenza Vaccine- Related Websites. iujp. 2026 Jan. 1;55(3):480-5. doi:10.26650/IstanbulJPharm.2025.1742131