Research Article

Combining Artificial Algae AlgorithmtoArtificial Neural Networkfor Optimization of Weights

Volume: 1 Number: 1 December 27, 2018

Combining Artificial Algae AlgorithmtoArtificial Neural Networkfor Optimization of Weights

Abstract

Artificial Neural Network (ANN) is one of the most important artificial intelligent algorithms used for classification problems. The structure of ANN depends on the learning algorithm used for adjusting the weights between neurons of the layers according to the calculated error between model value and the real value. Recently the weights between layers in ANN has been optimized by using metaheuristic optimization algorithms. One of the recent high performance nonlinear optimization algorithms is Artificial Algae Algorithm (AAA) which is a bioinspired, successful, competitive and robust optimization algorithm. In this study, AAA was used as a tool for optimization of the weights in ANN algorithm. ANN and AAA was combined such that the training step of the ANN modeling to be performed by AAA. After training, ANN continues testing with the optimized weights. The established model combination (AAANN) was tested on three benchmarked datasets (Iris, Thyroid and Dermatology) of the UCI Machine Learning Repository to indicate the performance of this hybrid structure. The results were compared with MLP algorithm in terms of Mean Absolute Error (MAE). Accordingly, up to 96% reduction in mean MSE levels could be achieved by AAANN for all models.

Keywords

Artificial Neural Networks , Artificial Algae Algorithm , backpropagation , classification algorithms , optimization

References

  1. [1] L. Fausett, Fundamentals of Neural Networks Architectures Algorithms and Applications, Prentice Hall, Upper Saddle River, New Jersey, 1994.
  2. [2] S. Haykin, Neural Networks: A Comprehensive Foundation, New York: Macmillan, 1994.
  3. [3] V. G. Gudise ve G. K. Venayagamoorthy, "Comparison of Particle Swarm Optimization and Backpropagation as Training Algorithms for Neural Networks," Proc. of the 2003 IEEE Swarm Intelligence Symposium, 2003.
  4. [4] E. Momeni, R. Nazir, D. J. Armaghani ve H. Maizir, "Prediction of pile bearing capacity using a hybrid genetic algorithm-based ANN," Measurement, 2014, cilt 57, ss. 22–131.
  5. [5] D. J. Montana ve L. Davis, "Training Feedforward Neural Networks Using Genetic Algorithms," IEEE Int. Conf. on Systems, Man and Cybernetics, 2000.
  6. [6] B. A. Garro ve R. A. Vázquez, "Designing Artificial Neural Networks Using Particle Swarm Optimization Algorithms," Computational Intelligence and Neuroscience, 2015.
  7. [7] S. A. Uymaz, G. Tezel ve E. Yel, "Artificial algae algorithm (AAA) for nonlinear global optimization," Applied Soft Computing, cilt 31, ss. 153-171, 2015.
  8. [8] S. A. Uymaz, G. Tezel ve E. Yel, "Artificial algae algorithm with multi-light source for numerical optimization and applications," Biosystems, 2015, cilt 138, ss. 25-38.
  9. [9] X. Zhang, C. Wu, J. Li, X. Wang, Z. Yang, J. Lee ve K. Jung, "Binary artificial algae algorithm for multidimensional knapsack problems," Applied Soft Computing, 2016, cilt 43, ss. 583-595.
  10. [10] S. Korkmaz, A. Babalik ve M. S. Kiran, "An artificial algae algorithm for solving binary optimization problems," Int. J. of Machine Learning and Cybernetics, 2018, cilt 9(7), ss. 1233–1247.
IEEE
[1]G. Tezel, S. A. Uymaz, and E. Yel, “Combining Artificial Algae AlgorithmtoArtificial Neural Networkfor Optimization of Weights”, DataSCI, vol. 1, no. 1, pp. 37–44, Dec. 2018, [Online]. Available: https://izlik.org/JA97HR64ZB