Training of the feed-forward artificial neural networks using butterfly optimization algorithm
Abstract
Artificial Neural Network (ANN) learns from inputs and outputs. The values of the weights and biases in ANN are updated according to inputs and outputs. Researchers have proposed algorithms to train Multi-Layer Perceptron (MLP). However, classical techniques often face problems in solving this optimization problem. They tend to need large amounts of computing time, large amounts of memory. More importantly, they get stuck within the local optimum and produce poor-quality solutions. To overcome these difficulties, meta-heuristic algorithms have been used to train MLP. In this article, the Butterfly Optimization Algorithm (BOA) which was designed by modeling the behaviors of butterflies was used for the first time to train the multi-layer perceptron. The developed algorithm was named BOA-MLP where the BOA algorithm optimized the values of the weights and biases in the MLP. The success of the BOA-MLP algorithm was tested on five data sets (iris, breast cancer, heart, balloon and xor) which are frequently used in the literature. In the experiments, the BOA-MLP algorithm was compared with the BAT-MLP, SMS-MLP and BP algorithms. The average and standard deviation of the mean squared error, the average classification accuracy, the sensitivity, the specificity, the precision and the F1-score were used as the performance metrics. According to the experimental results, it is seen that the BOA-MLP algorithm surpasses the BAT-MLP, SMS-MLP and BP algorithms on all data sets and shows superior success.
Keywords
artificial neural networks, butterfly optimization algorithm, multi-layer perceptron, optimization, training of artificial neural networks
References
- Jaddi N.S., Abdullah S., “Optimization of neural network using kidney-inspired algorithm with control of filtration rate and chaotic map for real-world rainfall forecasting.” Engineering Applications of Artificial Intelligence, 67, (2018), 246-259.
- Türkoğlu B., “Artificial algae algori̇thm on training artificial neural networks.” 2019, Selcuk University Natural Science Institute.
- Haupt R.L., Ellen Haupt S., Practical genetic algorithms. 2004.
- Mirjalili S., “How effective is the Grey Wolf optimizer in training multi-layer perceptrons.” Applied Intelligence, 43(1), (2015), 150-161.
- Kulluk S., Ozbakir L., Baykasoglu A., “Training neural networks with harmony search algorithms for classification problems.” Engineering Applications of Artificial Intelligence, 25(1), (2012), 11-19.
- Ghaleini E.N., et al., “A combination of artificial bee colony and neural network for approximating the safety factor of retaining walls.” Engineering with Computers, 35(2), (2019), 647-658.
- Tang R., Fong S., Deb Ss, Vasilakos A.V., Millham R.C., “Dynamic group optimisation algorithm for training feed-forward neural networks.” Neurocomputing, 314, (2018), 1-19.
- Zhang L., Suganthan P.N., “A survey of randomized algorithms for training neural networks.” Information Sciences, 364, (2016), 146-155.
- Ojha V.K., Abraham A., Snášel V., “Metaheuristic design of feedforward neural networks: A review of two decades of research.” Engineering Applications of Artificial Intelligence, 60, (2017), 97-116.
- Hacibeyoglu M., Ibrahim M.H., “A novel multimean particle swarm optimization algorithm for nonlinear continuous optimization: application to feed-forward neural network training.” Scientific Programming. 2018.