Year 2021, Volume , Issue 34, Pages 64 - 71 2021-03-30

The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines

Aslı YAMAN [1] , Mehmet Ali CENGİZ [2]


Support Vector Machine (SVM) is a supervised machine learning method used for classification and regression. It is based on the Vapnik-Chervonenkis (VC) theory and Structural Risk Minimization (SRM) principle. Thanks to its strong theoretical background, SVM exhibits a high performance compared to many other machine learning methods. The selection of hyperparameters and the kernel functions is an important task in the presence of SVM problems. In this study, the effect of tuning hyperparameters and sample size for the kernel functions on SVM classification accuracy was investigated. For this, UCI datasets of different sizes and with different correlations were simulated. Grid search and 10-fold Cross-Validation methods were used to tune the hyperparameters. Then, SVM classification process was performed using three kernel functions, and classification accuracy values were examined.
Support vector machines, kernel function, tune parameter
  • B. E. Boser, I. M. Guyon, V. N. Vapnik, A Training Algorithm for Optimal Margin Classifiers, In Proceedings of the Fifth Annual Workshop on Computational Learning Theory (1992) 144-152.
  • V. N. Vapnik, The Nature of Statistical Learning Theory, New York: Springer-Verlag, 1995.
  • V. Jakkula, Tutorial on Support Vector Machine (SVM), School of EECS, Washington State University, (2006) 37.
  • S. Han, C. Qubo, H. Meng, Parameter Selection in SVM with RBF Kernel Function, In World Automation Congress (2012) 1-4 Puerto Vallarta, Mexico.
  • X. Chen, J. He, X. Wu, W. Yan, W. Wie, Sleep Staging by Bidirectional Long Short-term Memory Convolution Neural Network, Future Generation Computer Systems 109 (2020) 188-196.
  • J. K. Appati, G. K. Gogovi, G. O. Fosu, On the Selection of Appropriate Kernel Function for SVM in Face Recognition, International Journal of Advanced Research in Computer Science and Software Engineering 4(3) (2014) 6-9.
  • W. M. Campbell, J. P. Campbell, D. A. Reynolds, E. Singer, P. A. Torres-Carrasquillo, Support Vector Machines for Speaker and Language Recognition, Computer Speech and Language 20(2-3) (2006) 210-229.
  • S. Bellamkonda, N. P. Gopalan, A Facial Expression Recognition Model Using Support Vector Machines, IJ Mathematical Sciences and Computing 4 (2018) 56-65.
  • M. Rezaei, E. Zereshki, H. Sharini, M. Gharib Salehi, F. Naleini, Detection of Alzheimer’s Disease Based on Magnetic Resonance Imaging of The Brain Using Support Vector Machine Model, Tehran University Medical Journal TUMS Publications 76(6) (2018) 410-416.
  • Ö. Y. Akşehirli, H. Ankaralı, D. Aydın, Ö. Saraçlı, An Alternative Approach in Medical Diagnosis: Support Vector Machines, Türkiye Klinikleri Journal of Biostatistics 5(1) (2013) 19-28.
  • F. E. Tay, L. Cao, Application of Support Vector Machines in Financial Time Series Forecasting, Omega 29(4) (2001) 309-317.
  • P. Wang, R. Mathieu, J. Ke, H. J. Cai, Predicting Criminal Recidivism with Support Vector Machine, International Conference on Management and Service Science (2010) Wuhan, China.
  • J. Karia, Stock Market Prediction Using Machine Learning, International Journal of Emerging Technology and Computer Science 3(2) (2018) 159-162.
  • J. Wainer, P. Fonseca, How to Tune The RBF SVM Hyperparameters?: An Empirical Evaluation of 18 Search Algorithms.” arXiv preprint arXiv:2008.11655 (2020).
  • D. Fradkin, I. Muchnik, Support Vector Machines for Classification, DIMACS Series in Discrete Mathematics and Theoretical Computer Science 70 (2006) 13-20.
  • S. R. Gunn, Support Vector Machines for Classification and Regression, ISIS Technical Report 14(1) (1998) 5-16.
  • C. F. Lin, S. D. Wang, Fuzzy Support Vector Machines, IEEE Transactions on Neural Networks 13(2) (2002) 464-471.
  • C. Savas, F. Dovis, The Impact of Different Kernel Functions on The Performance of Scintillation Detection Based on Support Vector Machines, Sensors 19(23) (2019) 1-16.
  • D. Dua, C. Graff, UCI Machine Learning Repository [http://archive.ics.uci.edu/ml], Irvine, CA: University of California, School of Information and Computer Science, (2019).
Primary Language en
Subjects Mathematics, Interdisciplinary Applications, Mathematics, Applied
Journal Section Research Article
Authors

Orcid: 0000-0003-2886-6765
Author: Aslı YAMAN (Primary Author)
Institution: ONDOKUZ MAYIS UNIVERSITY
Country: Turkey


Orcid: 0000-0002-1271-2588
Author: Mehmet Ali CENGİZ
Institution: ONDOKUZ MAYIS UNIVERSITY
Country: Turkey


Dates

Publication Date : March 30, 2021

Bibtex @research article { jnt876920, journal = {Journal of New Theory}, issn = {}, eissn = {2149-1402}, address = {Mathematics Department, Gaziosmanpasa University 60250 Tokat-TURKEY.}, publisher = {Gaziosmanpasa University}, year = {2021}, volume = {}, pages = {64 - 71}, doi = {}, title = {The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines}, key = {cite}, author = {Yaman, Aslı and Cengiz, Mehmet Ali} }
APA Yaman, A , Cengiz, M . (2021). The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines . Journal of New Theory , (34) , 64-71 . Retrieved from https://dergipark.org.tr/en/pub/jnt/issue/61070/876920
MLA Yaman, A , Cengiz, M . "The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines" . Journal of New Theory (2021 ): 64-71 <https://dergipark.org.tr/en/pub/jnt/issue/61070/876920>
Chicago Yaman, A , Cengiz, M . "The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines". Journal of New Theory (2021 ): 64-71
RIS TY - JOUR T1 - The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines AU - Aslı Yaman , Mehmet Ali Cengiz Y1 - 2021 PY - 2021 N1 - DO - T2 - Journal of New Theory JF - Journal JO - JOR SP - 64 EP - 71 VL - IS - 34 SN - -2149-1402 M3 - UR - Y2 - 2021 ER -
EndNote %0 Journal of New Theory The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines %A Aslı Yaman , Mehmet Ali Cengiz %T The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines %D 2021 %J Journal of New Theory %P -2149-1402 %V %N 34 %R %U
ISNAD Yaman, Aslı , Cengiz, Mehmet Ali . "The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines". Journal of New Theory / 34 (March 2021): 64-71 .
AMA Yaman A , Cengiz M . The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines. JNT. 2021; (34): 64-71.
Vancouver Yaman A , Cengiz M . The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines. Journal of New Theory. 2021; (34): 64-71.
IEEE A. Yaman and M. Cengiz , "The Effects of Kernel Functions and Optimal Hyperparameter Selection on Support Vector Machines", Journal of New Theory, no. 34, pp. 64-71, Mar. 2021