Examination of Distance Based Regression Methods for Different Data Structures in Animal Science

Abstract

Distance-based regression is an alternative method for parameter estimation in linear regression models when mixed-type explanatory variables are used. Distance-based regression is similar to classical linear regression, except that explanatory variables are measured by distance measures rather than raw values. In this study, datasets with sample sizes of 10, 25, 50, 100, 250 and 500 produced for Binomial, Normal, t, Chi-square and Poisson distributions of Euclidean, Gower and Manhattan distance measures and real data with discrete and continuous distribution that body weight at sixth months was used as outcome variable, body length and chest depth at sixth months of Saanen kids were used as explanatory variables as continuous data. Milk fat ratio was determined as the response variable, while the number of milking per day and the season of Polish Holstein Friesian cattle were determined as the explanatory variables as discrete data. It was aimed to determine the effect on the data sets (10, 50 and 100 sample sizes) by comparing the results obtained from the Linear Regression method. R packages "dbstats", "cluster" and "tidyverse" were used to perform the analysis. As a result, it has been determined that the use of Manhattan distance in data with Poisson distribution may produce unsuccessful results, especially in small sample sizes (n<50). Although there is no significant difference between Gower and Euclidean distances in different distributions according to sample sizes, it has been determined that the use of Euclidean distance measure in some distributions produces results that cause fluctuation. However, it has been understood that the Gower distance can be recommended as a more suitable choice since it has a more stable structure. For the applicability of the Least Square Estimation method, it may be recommended to use Distance Based Regression methods in cases where the necessary assumptions mentioned in this study cannot be met.

Keywords

• Distance measures
• Package dbstats
• Regression
• R software

References

1. Adıgüzel MB. 2021. Çok değişkenli uyarlanabilir regresyon eğrilerinde alternatif bilgi kriterleri ile model seçimi. PhD Thesis, Ondokuz Mayıs University, Graduate Shool of Education, Department of Statistics, Samsun, Türkiye, pp: 86.
2. Aerts J, Sitkowska B, Piwczyński D, Kolenda M, Önder H. 2022. The optimal level of factors for high daily milk yield in automatic milking system. Livestock Sci, 264: 105035.
3. Alma ÖG, Vupa Ö. 2008. Regresyon analizinde kullanılan en küçük kareler ve en küçük medyan kareler yöntemlerinin karşılaştırılması. SDÜ Fen Ede Fak Fen Derg, 3(2): 2019-229.
4. Alpar R. 2010. Basit doğrusal regresyon çözümlemesi: Spor, sağlık ve eğitim bilimlerinden örneklerle uygulamalı istatistik ve geçerlik-güvenirlik. Detay Yayıncılık, Ankara, Türkiye, pp: 672.
5. Alpar R. 2013. Uygulamalı çok değişkenli istatistiksel yöntemler. Detay Yayıncılık, Ankara, Türkiye, pp: 853.
6. Anderson MJ. 2001. A new method for non-parametric multivariate analysis of variance. Austral Ecol, 26: 32-46.
7. Anonymous. 2011. Kümeleme analizinde kullanılan bazı farklılık ve benzerlik ölçülerinin incelenmesi. URL: http://emredunder.blogspot.com/2011/06/kumeleme-analizinde-kullanlan-baz.html (accessed date: June18, 2023).
8. Anonymous. 2023a. Ankara Üniversitesi açık ders. URL: https://acikders.ankara.edu.tr/pluginfile.php/130799/mod_resource/content/0/6-%20Matris.pdf (accessed date: May 12, 2023).

9. Anonymous. 2023b. Model ve dağılım seçme URL: https://avys.omu.edu.tr/storage/app/public/kamilal/108861/HPTZ.HF10.pdf (accessed date: May 16, 2023).
10. Arenas C, Cuadras M. 2002. Recent statistical methods based on distances. Contrib Sci, 2(2): 183-191.
11. Arı A, Önder H. 2013. Farklı veri yapılarında kullanılabilecek regresyon yöntemleri. Anadolu Tar Bil Derg, 28(3): 168-174.
12. Atkinson AC, Riani M. 2000. Robust diagnostic regression analysis. Springer, New York, US, pp: 328.
13. Boj E, Claramunt MM, Fortiana J, Vidiella A. 2002. The use of distance-based regression and generalized linear models in the rate making process: An empirical study. Universitat de Barcelona. Institut de Matemàtica [IMUB], Barcelona, Spain, pp: 47.
14. Chen J, Bittinger K, Charlson ES, Hoffmann C, Lewis J, Wu GD, Li H. 2012. Associating microbiome composition with environmental covariates using generalized UniFrac distances. Bioinf, 28(16): 2106-2113.
15. Cuadras CM, Arenas C. 1990. A distance based regression model for prediction with mixed data. Commun Stat A. Theory Methods, 19: 2261-2279.
16. Cuadras CM. 1988 Statistical distances. Estadística Española, 30: 295-378.
17. de Souza Jr AH, Corona F, Barreto GA, Miche Y, Lendase A. 2015. Minimal learning machine: A novel supervised distance-based approach for regression and classification. Neurocomputing, 164: 34-44.
18. Ferreira Barreto CDS, Zimeo Morais GA, Vanzella P, Sato JR. 2020. Combining the intersubject correlation analysis and the multivariate distance matrix regression to evaluate associations between fNIRS signals and behavioral data from ecological experiments. Experl Brain Res, 238: 2399-2408. https://doi: 10.1007/s00221-020-05895-8
19. Gower JC. 1966. Some distance properties of latent root and vector methods used in multivariate analysis. Biometrika, 53(3-4): 325-338.
20. Gower JC. 1971. A general coefficient of similarity and some of its properties. Biometrics, 1971: 857-871.
21. Haron NH, Ahad NA, Mahat NI. 2019. Distance-based regression for non-normal data. The 4th Innovation and Analytics Conference & Exhibition (IACE 2019), March 21-28, Kedah, Malaysia. https://doi.org/10.1063/1.5121118
22. Kim C, Lee Y, Park BU. 2001. Cook’s distance in local polynomial regression. Stat Probab Lett, 54: 33-40.
23. Kurnaz B, Önder H, Piwczynski D, Kolenda M, Sitkowska B. 2021. Determination of the best model to predict milk dry matter in high milk yielding dairy cattle. Acta Sci Pol Zootechnica, 20(3): 41-44. https://doi: 10.21005/asp.2021.20.3.05
24. Kurnaz B, Önder H. 2021. Distance based regression models. II. International Applied Statistics Conference (UYIK-2021), June 29- July 2, Tokat, Türkiye, pp: 120-126.
25. Li J, Zhang W, Zhang S, Li Q. 2019. A theoretic study of a distance-based regression model. Sci China Math, 62: 979-998.
26. Lichstein JW. 2007. Multiple regression on distance matrices: a multivariate spatial analysis tool. Plant Ecol, 188: 117-131.
27. McArdle BH, Anderson MJ. 2001. Fitting multivariate models to community data: a comment on distance-based redundancy analysis. Ecology, 82(1): 290-297.
28. McQuarrie AD, Tsai CL. 1998. Regression and time series model selection. World Scientific Publication Co Pte. Ltd., London, UK, pp:45
29. Okur S. 2009. Parametrik ve parametrik olmayan doğrusal regresyon analiz yöntemlerinin karşılaştırılmalı olarak incelenmesi. MSc Thesis, Çukurova University, Institute of Science, Department of Animal Science, Adana, Türkiye, pp: 62.
30. Orhunbilge N. 2017. Uygulamalı regresyon ve korelasyon analizi. Nobel Yayıncılık, Ankara, Türkiye, pp: 394.
31. Önder H, Abacı SH. 2015. Path analysis for body measurements on body weight of Saanen kids. Kafkas Üniv Vet Fak Derg, 21(3): 351-354.
32. R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. 2022, URL: https://www.R-project.org/.
33. Raftery AE. 1995. Bayesian model selection in social research. Sociol Methodol, 25: 111-163.
34. Schork NJ, Wessel J, Malo N. 2008. DNA sequence-based phenotypic association analysis. Adv Genet, 60: 195-217.
35. Servi T. 2009. Çok değişkenli karma dağılım modeline dayalı kümeleme analizi. PhD Thesis, Çukurova University, Institute of Science, Department of Statistics, Adana, Türkiye, pp: 266.
36. Shehzad Z, Kelly C, Reiss PT, Craddock RC, Emerson JW, McMahon K, Milham MP. 2014. A multivariate distance-based analytic framework for connectome-wide association studies. Neuroimage, 93: 74-94.
37. Timm NH. 2002. Applied Multivariate Analysis. Splinger-Verlag, New York, US, pp: 718.
38. Ucal MŞ. 2006. Ekonometrik Model seçim kriterleri üzerine kisa bir inceleme. CÜ İİBF Derg, 7(2): 41-57.
39. URL1: https://acikders.ankara.edu.tr/pluginfile.php/130799/mod_resource/content/0/6-%20Matris.pdf (accessed date: May 12, 2023).
40. URL2: http://emredunder.blogspot.com/2011/06/kumeleme-analizinde-kullanlan-baz.html (accessed date: June18, 2023).
41. URL3: https://avys.omu.edu.tr/storage/app/public/kamilal/108861/HPTZ.HF10.pdf (accessed date: May 16, 2023).
42. Ünlükaplan Y. 2008. Çok değişkenli istatistiksel yöntemlerin peyzaj ekolojisi araştırmalarında kullanımı. PhD Thesis, Çukurova University, Institute of Science, Department of Statistics, Adana, Türkiye, pp: 156.
43. Varoquaux G, Craddock RC. 2013. Learning and comparing functional connectomes across subjects. NeuroImage, 80: 405-415.
44. Vural A. 2007. Aykırı değerlerin regresyon modellerine etkileri ve sağlam kestiriciler. MSc Thesis, Marmara University, Institute of Social Sciecnes, Department of Econometry, İstanbul, Türkiye, pp: 73.
45. Wasserman L. 2000. Bayesian model selection and model averaging. J Math Psychol, 44(1): 92-107.
46. Weisberg S. 2005. Applied linear regression. John Wiley & Sons, New Jersey, US, pp: 340.
47. Wessel J, Schork NJ. 2006. Generalized genomic distance-based regression methodology for multilocus association analysis. Amer J Human Genet, 79(5): 792-806.
48. Xu Y, Guo X, Sun J, Zhao Z. 2015. Snowball: resampling combined with distance-based regression to discover transcriptional consequences of a driver mutation. Bioinformatics, 31(1): 84-93.
49. Yıldız M. 2022. Dolar ve Euro kurları üzerinde etkili faktörlerin iki bağımlı değişkenli MARS modeli ile belirlenmesi. Kastamonu Üniv İİBF Derg, 24(1): 6-29.
50. Zapala MA, Schork NJ. 2012. Statistical properties of multivariate distance matrix regression for high-dimensional data analysis. Front Genet, 3: 190. https/doi.org/10.3389/fgene.2012.00190