Reporting quality of animal studies published in journals listed in ULAKBIM TR index: a systematic review on compliance to the ARRIVE guidelines

Selda Emre Aydıngöz; Oğuzhan Ekin Efe; Gökçe Çalışkan

Reporting quality of animal studies published in journals listed in ULAKBIM TR index: a systematic review on compliance to the ARRIVE guidelines

Abstract

Transparent reporting of animal studies is key to ensure reproducibility. The primary guideline for reporting animal studies is the ARRIVE (Animal Research: Reporting of In Vivo Experiments). We aimed to evaluate the compliance to the updated ARRIVE guidelines (version 2.0, date 2020) in animal studies published in journals indexed by the Turkish Academic Network and Information Centre (ULAKBIM TR Index). This was a retrospective analysis of reporting quality of animal studies published in journals listed in ULAKBIM TR Index between January 2010 and August 2021. The percentage of articles that fully reported each " of the ARRIVE Essential 10: Compliance Questionnaire was calculated, and effects of journal- and article-related factors were evaluated. Totally, 235 articles published in 89 journals were included into the analysis. The mean percentage of fully reported items was 59.1%±10.9%, the least reported items being those related with bias— “blinding”, “allocation to study groups”, “assessment of statistical assumptions”, “excluded animals”, and “sample size calculation” (0.9%-10.6%). The journal’s publisher, frequency, language, being indexed in the Science Citation Index Expanded, and the ratio of animal studies had no significant effect on this percentage (p>0.05). However, journals supporting the ARRIVE guidelines had significantly higher compliance (62.1%±10.1% vs. 58.2%±11.0% for supporters and non-supporters, respectively; p=0.017, 95%CI -7.0 to -0.7). Articles published after 2015 had higher compliance to the ARRIVE guidelines than those published previously (60.9%±10.4% vs. 57.9%±11.1%, respectively; p=0.037, 95%CI -5.8 to -0.2). Although progress has been made, compliance to the ARRIVE guidelines is still low in animal studies published in journals listed in ULAKBIM TR Index—Turkey's scientific journal database that covers over 800 peer-review journals. In order to increase the reporting quality and reproducibility of animal studies, it is imperative to raise awareness among researchers and journals, and to enforce the ARRIVE guidelines in editorial policy of journals.

Keywords

References

[1] Lewis DI. Animal experimentation: implementation and application of the 3Rs. Emerg Top Life Sci. 2019; 3(6): 675 679. [crossref]
[2] McGonigle P, Ruggeri B. Animal models of human disease: challenges in enabling translation. Biochem Pharmacol. 2014; 87(1):162-171. [crossref]
[3] Akhtar A. The flaws and human harms of animal experimentation. Camb Q Healthc Ethics. 2015; 24(4): 407-419. [crossref]
[4] Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG. Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLoS Biol. 2010; 8(6): e1000412. [crossref]
[5] Percie du Sert N, Hurst V, Ahluwalia A, Alam S, Avey MT, Baker M, Browne WJ, Clark A, Cuthill IC, Dirnagl U, Emerson M, Garner P, Holgate ST, Howells DW, Karp NA, Lazic SE, Lidster K, MacCallum CJ, Macleod M, Pearl EJ, Petersen OH, Rawle F, Reynolds P, Rooney K, Sena ES, Silberberg SD, Steckler T, Würbel H. The ARRIVE guidelines 2.0: updated guidelines for reporting animal research. J Physiol. 2020; 598(18): 3793-3801. [crossref]
[6] Delgado-Ruiz RA, Calvo-Guirado JL, Romanos GE. Critical size defects for bone regeneration experiments in rabbit calvariae: systematic review and quality evaluation using ARRIVE guidelines. Clin Oral Implants Res. 2015; 26(8): 915-930. [crossref]
[7] Leung V, Rousseau-Blass F, Beauchamp G, Pang DSJ. ARRIVE has not ARRIVEd: Support for the ARRIVE (Animal Research: Reporting of in vivo Experiments) guidelines does not improve the reporting quality of papers in animal welfare, analgesia or anesthesia. PLoS One. 2018; 13(5): e0197882.
[8]Enserink, M. Sloppy reporting on animal studies proves hard to change. Science 2017; 357: 1337–1338. [crossref]

[9] Gosselin RD. Insufficient transparency of statistical reporting in preclinical research: a scoping review. Sci Rep. 2021; 11(1): 3335. [crossref]
[10] Zhao B, Jiang Y, Zhang T, Shang Z, Zhang W, Hu K, Chen F, Mei F, Gao Q, Zhao L, Kwong JSW, Ma B. Quality of interventional animal experiments in Chinese journals: compliance with ARRIVE guidelines. BMC Vet Res. 2020; 16(1): 460. [crossref]
[11] Liu Y, Zhao X, Mai Y, Li X, Wang J, Chen L, Mu J, Jin G, Gou H, Sun W, Feng Y. Liu Y, et al. Adherence to ARRIVE Guidelines in Chinese Journal Reports on Neoplasms in Animals. PLoS One. 2016; 11(5): e0154657. [crossref]
[12] Gupta SK. A study to assess the methodological quality of in vivo animal experiments published in Indian journal of pharmacology: A retrospective, cross-sectional, observational study. Indian J Pharmacol. 2019; 51(1): 11-16. [crossref]
[13] Bezdjian A, Klis SFL, Peters JPM, Grolman W, Stegeman I. Quality of reporting of otorhinolaryngology articles using animal models with the ARRIVE statement. Lab Anim. 2018; 52(1): 79-87. [crossref]
[14] Nam MH, Chun MS, Seong JK, Kim HG. Ensuring reproducibility and ethics in animal experiments reporting in Korea using the ARRIVE guideline. Lab Anim Res. 2018; 34(1): 11-19. [crossref]
[15] The Turkish Academic Network and Information Centre (ULAKBIM). https://ulakbim.tubitak.gov.tr/en (accessed Sep 01, 2021).
[16] TR Index: Bibliographic / full text database containing articles in the fields of Science and Social Sciences developed by TUBITAK ULAKBIM. https://trdizin.gov.tr/en/home/ (accessed Sep 01, 2021).
[17] Landis SC, Amara SG, Asadullah K, Austin CP, Blumenstein R, Bradley EW, Crystal RG, Darnell RB, Ferrante RJ, Fillit H, Finkelstein R, Fisher M, Gendelman HE, Golub RM, Goudreau JL, Gross RA, Gubitz AK, Hesterlee SE, Howells DW, Huguenard J, Kelner K, Koroshetz W, Krainc D, Lazic SE, Levine MS, Macleod MR, McCall JM, Moxley RT 3rd, Narasimhan K, Noble LJ, Perrin S, Porter JD, Steward O, Unger E, Utz U, Silberberg SD. A call for transparent reporting to optimize the predictive value of preclinical research. Nature. 2012; 490(7419): 187-191. [crossref]
[18] Ormandy EH, Weary DM, Cvek K, Fisher M, Herrmann K, Hobson-West P, McDonald M, Milsom W, Rose M, Rowan A, Zurlo J, von Keyserlingk MAG. Animal Research, Accountability, Openness and Public Engagement: Report from an International Expert Forum. Animals (Basel). 2019; 9(9): 622. [crossref]
[19] Alemán-Laporte J, Alvarado G, Sa Garcia-Gomes M, Fonseca Brasil Antiorio AT, Zúñiga-Montero M, Cabrera Mori CM. Quality of Adherence to the ARRIVE Guidelines in the Material and Methods Section in Studies Where Swine Were Used as Surgical Biomodels: A Systematic Review (2013-2018). Animals (Basel). 2019; 9(11): 947. [crossref]
[20] Jasińska-Stroschein M, Orszulak-Michalak D. Reporting experimental studies on animals - The problems with translating of outcomes to clinical benefits. Methodological and statistical considerations: The example of pulmonary hypertension. Eur J Pharmacol. 2021; 897: 173952. [crossref]
[21] Ting KH, Hill CL, Whittle SL. Quality of reporting of interventional animal studies in rheumatology: a systematic review using the ARRIVE guidelines. Int J Rheum Dis. 2015; 18(5): 488-494. [crossref]
[22] Gulin JE, Rocco DM, García-Bournissen F. Quality of Reporting and Adherence to ARRIVE Guidelines in Animal Studies for Chagas Disease Preclinical Drug Research: A Systematic Review. PLoS Negl Trop Dis. 2015; 9(11): e0004194. [crossref]
[23] Avey MT, Moher D, Sullivan KJ, Fergusson D, Griffin G, Grimshaw JM, Hutton B, Lalu MM, Macleod M, Marshall J, Mei SH, Rudnicki M, Stewart DJ, Turgeon AF, McIntyre L; Canadian Critical Care Translational Biology Group. The Devil Is in the Details: Incomplete Reporting in Preclinical Animal Research. PLoS One. 2016; 11(11): e0166733. [crossref]
[24] Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, Moher D. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Int J Surg. 2021; 88: 105906. [crossref]
[25] Information Note on Ethics Committee Approval, 2020 The Scienific and Technologıcal Research Council of Turkey (TUBITAK) [online]. https://tubitak.gov.tr/sites/default/files/20689/ekbn_2020.pdf (accessed Sep 01, 2021).

Details

Primary Language

English

Subjects

Medical Pharmacology

Journal Section

Review

Authors

Selda Emre Aydıngöz
0000-0001-7823-7620
Türkiye

Oğuzhan Ekin Efe
0000-0002-3243-7843
Türkiye

Gökçe Çalışkan ^*
0000-0001-6360-2293
Türkiye

Publication Date

June 28, 2025

Submission Date

November 9, 2021

Acceptance Date

April 20, 2022

Published in Issue

Year 2022 Volume: 26 Number: 4

IZ

https://izlik.org/JA55UF53HR

Cite

RIS / Bibtex

APA

Emre Aydıngöz, S., Efe, O. E., & Çalışkan, G. (2025). Reporting quality of animal studies published in journals listed in ULAKBIM TR index: a systematic review on compliance to the ARRIVE guidelines. Journal of Research in Pharmacy, 26(4), 704-713. https://izlik.org/JA55UF53HR

AMA

1.Emre Aydıngöz S, Efe OE, Çalışkan G. Reporting quality of animal studies published in journals listed in ULAKBIM TR index: a systematic review on compliance to the ARRIVE guidelines. J. Res. Pharm. 2025;26(4):704-713. https://izlik.org/JA55UF53HR

Chicago

Emre Aydıngöz, Selda, Oğuzhan Ekin Efe, and Gökçe Çalışkan. 2025. “Reporting Quality of Animal Studies Published in Journals Listed in ULAKBIM TR Index: A Systematic Review on Compliance to the ARRIVE Guidelines”. Journal of Research in Pharmacy 26 (4): 704-13. https://izlik.org/JA55UF53HR.

EndNote

Emre Aydıngöz S, Efe OE, Çalışkan G (June 1, 2025) Reporting quality of animal studies published in journals listed in ULAKBIM TR index: a systematic review on compliance to the ARRIVE guidelines. Journal of Research in Pharmacy 26 4 704–713.

IEEE

[1]S. Emre Aydıngöz, O. E. Efe, and G. Çalışkan, “Reporting quality of animal studies published in journals listed in ULAKBIM TR index: a systematic review on compliance to the ARRIVE guidelines”, J. Res. Pharm., vol. 26, no. 4, pp. 704–713, June 2025, [Online]. Available: https://izlik.org/JA55UF53HR

ISNAD

Emre Aydıngöz, Selda - Efe, Oğuzhan Ekin - Çalışkan, Gökçe. “Reporting Quality of Animal Studies Published in Journals Listed in ULAKBIM TR Index: A Systematic Review on Compliance to the ARRIVE Guidelines”. Journal of Research in Pharmacy 26/4 (June 1, 2025): 704-713. https://izlik.org/JA55UF53HR.

JAMA

1.Emre Aydıngöz S, Efe OE, Çalışkan G. Reporting quality of animal studies published in journals listed in ULAKBIM TR index: a systematic review on compliance to the ARRIVE guidelines. J. Res. Pharm. 2025;26:704–713.

MLA

Emre Aydıngöz, Selda, et al. “Reporting Quality of Animal Studies Published in Journals Listed in ULAKBIM TR Index: A Systematic Review on Compliance to the ARRIVE Guidelines”. Journal of Research in Pharmacy, vol. 26, no. 4, June 2025, pp. 704-13, https://izlik.org/JA55UF53HR.

Vancouver

1.Selda Emre Aydıngöz, Oğuzhan Ekin Efe, Gökçe Çalışkan. Reporting quality of animal studies published in journals listed in ULAKBIM TR index: a systematic review on compliance to the ARRIVE guidelines. J. Res. Pharm. [Internet]. 2025 Jun. 1;26(4):704-13. Available from: https://izlik.org/JA55UF53HR