A Bayesian Approach to Binary Logistic Regression Model with Application to OECD Data

Asuman Yılmaz; H.eray Çelik

doi:10.53433/yyufbed.837533

EN TR

A Bayesian Approach to Binary Logistic Regression Model with Application to OECD Data

Abstract

In spite of being a common method for estimating the model parameters, Maximum Likelihood (ML) method may give bias results for small sample sizes. To overcome this problem, Bayesian method is usually utilized to obtain the estimates of the model parameters as an alternative to the ML method. In this study, a real data set was analyzed by using the binary logistic regression model. Parameters of the binary logistic regression model were estimated by using ML and Bayesian methods. Modeling performance of the binary logistics regression model based on the Bayesian estimates was compared with the model based on the ML estimates. Well-known information criteria such as AIC and BIC were used in this comparison.

Keywords

Binary-Logistic regression, Maximum likelihood, Bayesian method

References

Acquah, H. D. (2013). Bayesian logistic regression modelling via Markov chain Monte Carlo algorithm. Journal of Social and Development Sciences, 4, 193-197. doi: 10.22610/jsds.v4i4.751
Agresti, A., & Hitchcock, D. B. (2005). Bayesian inference for categorical data analysis. Statistical Methodsand Applications, 14(3), 297-330. doi:10.1007/s10260-005-0121-y
Albert, J. H., & Chib. S. (1993). Bayesian analysis of binary and polychotomous response data. Journal of the American Statistical Association, 88, 669-679. doi:10.2307/2290350
Cowles, M. K., & Carlin, B. P. (1996). Markov chain Monte Carlo convergence diagnostics: a comparative review. Journal of the American Statistical Association, 91, 883-904.
Dagliati, A., Malovini, A., Decata, P., Cogni, G., Teliti, M., Sacchi, L., & Bellazzi, R. (2016). Hierarchical Bayesian Logistic Regression to forecast metabolic control in type 2 DM patients. In AMIA Annual Symposium Proceedings,2016, 470-479.
Dos Santos, M. A., Moala, F. A., & Tachibana, V. M. (2009). Approximate Bayesian methods for logistic regression model. Revista Brasileira de Biometria, 27, 288-300.
Geyer, C. J. (1992). Practical markov chain montecarlo. Statistical Science, 10, 473-483.
Ghosh, J., Li, Y., & Mitra, R. (2018). On the use of Cauchy prior distributions for Bayesian logistic regression. Bayesian Analysis, 13, 359-383. doi:10.1214/17-BA1051
Griffiths, D. A. (1973). Maximum likelihood estimation for the beta-binomial distribution and an application to the household distribution of the total number of cases of a disease, Biometrics, 7,637-648.
Groenewald, P. C., & Mokgatlhe, L. (2005). Bayesian computation for logistic regression. Computational Statistics & Data Analysis, 48, 857-868. doi:10.1016/j.csda.2004.04.009

Hair, F. T., William, C. B., Babin, B. T., & Anderson E. R. (2006). Overview of Multivariate Methods. Oxford, UK: Wiley & Sons.
Huggins, J. H., Campbell, T., & Broderick, T. (2016). Coresets for scalable bayesian logistic regression. arXiv preprint arXiv:1605.06423.
Lukman, P. A., Abdullah, S., & Rachman, A. (2021). Bayesian logistic regression and its application for hypothyroid prediction in post-radiation nasopharyngeal cancer patients. In Journal of Physics: Conference Series, 1725(1), 012010. doi:10.1088/1742-6596/1725/1/012010
Rashwan, N. I., & El Dereny, M. (2012). The comparison between result of application Bayesian and maximum likelihood approaches on logistic regression model for prostate cancer data. Applied Mathematical Scienses, 6, 1143-1158.
Suleiman, M., Demirhan, H., Boyd, L., Girosi, F., & Aksakalli, V. (2019). Bayesian logistic regression approaches to predict incorrect DRG assignment. Health care management science, 22(2), 364-375. doi: 10.1007/s10729-018-9444-8.
Spyroglou, I. I., Spöck, G., Chatzimichail, E. A., Rigas, A., & Paraskakis, E. (2018). A Bayesian logistic regression approach in asthma persistence prediction. Epidemiology, Biostatistics and Public Health, 15(1). doi:10.2427/12777.
Tektaş, D., & Günay, S. (2008). Bayesian approach to parameter estimation in binary logit models. Hacettepe Journal of Mathematics and Statistics, 37, 167-176.
Zellner, A., & Rossi, P.E. (1984). Bayesian analysis of dichotomous quantal response models. Journal of Econometrics, 25, 365-393.

Details

Primary Language

English

Subjects

-

Journal Section

Research Article

Authors

Asuman Yılmaz ^*
0000-0002-8653-6900
Türkiye

H.eray Çelik
0000-0001-7490-8124
Türkiye

Publication Date

August 31, 2021

Submission Date

December 8, 2020

Acceptance Date

July 7, 2021

Published in Issue

Year 2021 Volume: 26 Number: 2

DOI

https://doi.org/10.53433/yyufbed.837533

IZ

https://izlik.org/JA55JG97FH

APA

Yılmaz, A., & Çelik, H. (2021). A Bayesian Approach to Binary Logistic Regression Model with Application to OECD Data. Yüzüncü Yıl Üniversitesi Fen Bilimleri Enstitüsü Dergisi, 26(2), 94-101. https://doi.org/10.53433/yyufbed.837533

AMA

1.Yılmaz A, Çelik H. A Bayesian Approach to Binary Logistic Regression Model with Application to OECD Data. YYU JINAS. 2021;26(2):94-101. doi:10.53433/yyufbed.837533

Chicago

Yılmaz, Asuman, and H.eray Çelik. 2021. “A Bayesian Approach to Binary Logistic Regression Model With Application to OECD Data”. Yüzüncü Yıl Üniversitesi Fen Bilimleri Enstitüsü Dergisi 26 (2): 94-101. https://doi.org/10.53433/yyufbed.837533.

EndNote

Yılmaz A, Çelik H (August 1, 2021) A Bayesian Approach to Binary Logistic Regression Model with Application to OECD Data. Yüzüncü Yıl Üniversitesi Fen Bilimleri Enstitüsü Dergisi 26 2 94–101.

IEEE

[1]A. Yılmaz and H. Çelik, “A Bayesian Approach to Binary Logistic Regression Model with Application to OECD Data”, YYU JINAS, vol. 26, no. 2, pp. 94–101, Aug. 2021, doi: 10.53433/yyufbed.837533.

ISNAD

Yılmaz, Asuman - Çelik, H.eray. “A Bayesian Approach to Binary Logistic Regression Model With Application to OECD Data”. Yüzüncü Yıl Üniversitesi Fen Bilimleri Enstitüsü Dergisi 26/2 (August 1, 2021): 94-101. https://doi.org/10.53433/yyufbed.837533.

JAMA

1.Yılmaz A, Çelik H. A Bayesian Approach to Binary Logistic Regression Model with Application to OECD Data. YYU JINAS. 2021;26:94–101.

MLA

Yılmaz, Asuman, and H.eray Çelik. “A Bayesian Approach to Binary Logistic Regression Model With Application to OECD Data”. Yüzüncü Yıl Üniversitesi Fen Bilimleri Enstitüsü Dergisi, vol. 26, no. 2, Aug. 2021, pp. 94-101, doi:10.53433/yyufbed.837533.

Vancouver

1.Asuman Yılmaz, H.eray Çelik. A Bayesian Approach to Binary Logistic Regression Model with Application to OECD Data. YYU JINAS. 2021 Aug. 1;26(2):94-101. doi:10.53433/yyufbed.837533

Cited By

EGG QUALITY ASSESSMENT: A MODEL COMPARISON APPROACH USING BAYESIAN MIXED LOGIT, MIXED LOGIT, LOGISTIC REGRESSION AND MULTINOMIAL REGRESSION MODELS

FUDMA JOURNAL OF SCIENCES

https://doi.org/10.33003/fjs-2025-0905-3656

Comparative analysis of frequentist, Bayesian, and machine learning models for predicting SARS-CoV-2 PCR positivity

Frontiers in Artificial Intelligence

https://doi.org/10.3389/frai.2025.1668477