Artificial Intelligence-Assisted Disease and Welfare Detection in Farm Animals: A Diagnostic Test Accuracy Systematic Review and Meta-Analysis
Abstract
To estimate, against a reference standard, how accurately artificial intelligence methods detect disease and welfare conditions in farm animals. PubMed, Web of Science, and Scopus were searched for primary diagnostic accuracy studies, with an updated search during revision for additional animal-level lameness studies. When a 2×2 table was not reported, the table was reconstructed from the reported metrics and checked for internal consistency. Eligible studies were pooled with a bivariate random-effects model, and the results were checked with independent estimators. Heterogeneity, publication bias, sensitivity analyses, risk of bias, and certainty of evidence were assessed. Seventy-four of 154 full texts met the inclusion criteria. Under an eligibility criterion amended in review to keep within-group sample sizes comparable (animal-level N ≤ 500 cows), three large-sample studies were excluded and one small-sample study was added through the updated search; ten studies entered the primary meta-analysis (seven on mastitis and three on lameness). A single-study reproduction/metritis dataset was excluded from pooling and synthesised narratively. Pooled sensitivity was 83.5% (95% confidence interval 74.0–90.0) and pooled specificity was 90.1% (95% confidence interval 85.4–93.3), with an area under the curve of 0.936 and a diagnostic odds ratio of 46. The mastitis subgroup (k=7) reached 83.5% sensitivity and 88.9% specificity; the three-study lameness subgroup is reported as exploratory. Heterogeneity was substantial, and most studies could not be pooled because they reported performance at the record or quarter level rather than per animal. Artificial intelligence-based detection appears promising, combining high specificity with good sensitivity, but wide heterogeneity, the small number of poolable studies, and low certainty of evidence all call for cautious interpretation.
Keywords
Artificial intelligence, Diagnostic test accuracy, Lameness, Mastitis, Meta-analysis, Precision livestock farming
Ethical Statement
Thanks
References
- Beer, G., Alsaaod, M., Starke, A., Schuepbach-Regula, G., Müller, H., Kohler, P., & Steiner, A. (2016). Use of extended characteristics of locomotion and feeding behavior for automated identification of lame dairy cows. PLOS One, 11(5), e0155796. https://doi.org/10.1371/journal.pone.0155796
- Borghart, G. M., O’Grady, L. E., & Somers, J. R. (2021). Prediction of lameness using automatically recorded activity, behavior and production data in post-parturient Irish dairy cows. Irish Veterinary Journal, 74(1), 4. https://doi.org/10.1186/s13620-021-00182-6
- Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., Kressel, H. Y., Rifai, N., Golub, R. M., Altman, D. G., Hooft, L., Korevaar, D. A., Cohen, J. F., & STARD Group. (2015). STARD 2015: An updated list of essential items for reporting diagnostic accuracy studies. Radiology, 277(3), 826-832. https://doi.org/10.1136/bmj.h5527
- Collins, G. S., Dhiman, P., Andaur Navarro, C. L., Ma, J., Hooft, L., Reitsma, J. B., Logullo, P., Beam, A. L., Peng, L., Van Calster, B., van Smeden, M., Riley, R. D., & Moons, K. G. (2021). Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence. BMJ Open, 11(7), e048008. https://doi.org/10.1136/bmjopen-2020-048008
- Collins, G. S., Moons, K. G., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., ... & Logullo, P. (2024). TRIPOD+ AI statement: Updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ, 385, e078378. https://doi.org/10.1136/bmj-2023-078378
- Deeks, J. J., Bossuyt, P. M., Leeflang, M. M., & Takwoingi, Y. (2023). Cochrane handbook for systematic reviews of diagnostic test accuracy. John Wiley & Sons.
- Deeks, J. J., Macaskill, P., & Irwig, L. (2005). The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. Journal of Clinical Epidemiology, 58(9), 882-893. https://doi.org/10.1016/j.jclinepi.2005.01.016
- Dervić, E., Matzhold, C., Egger-Danner, C., Steininger, F., & Klimek, P. (2024). Improving lameness detection in cows: A machine learning algorithm application. Journal of Dairy Science, 107(12), 11550-11562. https://doi.org/10.3168/jds.2024-24730
- Distante, D., Albanello, C., Zaffar, H., Faralli, S., & Amalfitano, D. (2025). Artificial intelligence applied to precision livestock farming: A tertiary study. Smart Agricultural Technology, 11, 100889. https://doi.org/10.1016/j.atech.2025.100889
- Džermeikaitė, K., Krištolaitytė, J., & Antanaitis, R. (2025a). Application of machine learning models for the early detection of metritis in dairy cows based on physiological, behavioural and milk quality indicators. Animals, 15(11), 1674. https://doi.org/10.3390/ani15111674