A Critical Review of Major Nature-Inspired Optimization Algorithms

Year 2018, Issue: 2, 376 - 394, 19.08.2018

Julius Beneoluchi Odılı Noraziah A. Radzi Ambar Mohd Helmy Abd Wahab

Abstract

Nature-inspired Algorithms are getting more and
more popular in the past few decades owing to their amazing successes in
solving a number of real-world optimization problems in different spheres of
human endeavour ranging from the financial, medical and industrial to
educational applications etc. Nature-inspired Algorithms (NAs) simulate the
harmonious cooperation and competition in nature resulting in amazing solutions
to seemingly impossible human problems. This paper examines ten nature-inspired
techniques and their applications to different fields of human endeavour and
concludes that the Nature-inspired Algorithms has enormous promise in the quest
for greater human development through the harnessing of NAs’ potentials for
speeding-up of industrial processes, minimization of time, financial and
computer resources required to obtain solutions to complex optimization
problems etc. However, the study points out certain areas of concern in the
development of the NAs, namely, the apparent lack of clear mathematical cum
theoretical proofs of convergence of these algorithms, manual tuning of
parameters and the recurring issue of experimenting with small-scale problems
vi-a-vis the large and complex real-life problems. 

Keywords

Nature-inspired algorithms, Metaheuristics, Trajectory-based, Population-based, Deterministic algorithms

References

• Aghamohammadi, M., & Pourgholi, M. (2008). Experience with SSFR test for synchronous generator model identification using Hook-Jeeves optimization method. International Journal of System Applications, Engineering and Development, 2(3), 122-127. Akay, B., & Karaboga, D. (2015). A survey on the applications of artificial bee colony in signal, image, and video processing. Signal, Image and Video Processing, 9(4), 967-990. Al Gizi, A. J., Mustafa, M., Al Zaidi, K. M., & Al-Zaidi, M. K. (2015). Integrated PLC-fuzzy PID Simulink implemented AVR system. International Journal of Electrical Power & Energy Systems, 69, 313-326. Alba, E., Talbi, E., Luque, G., & Melab, N. (2005). 4. Metaheuristics and Parallelism. Parallel Metaheuristics: A New Class of Algorithms. Wiley, 79-104. Alroomi, A. R., Albasri, F. A., & Talaq, J. H. (2013). Solving the Associated Weakness of Biogeography-Based Optimization Algorithm. International Journal on Soft Computing, 4(4), 1-20. Anwar, I. M., Salama, K. M., & Abdelbar, A. M. (2015). Instance Selection with Ant Colony Optimization. Procedia Computer Science, 53, 248-256. Babaeizadeh, S., & Ahmad, R. (2014). A Modified Artificial Bee Colony Algorithm for Constrained Optimization Problems. Journal of Convergence Information Technology, 9(6), 151. Banzhaf, W., Nordin, P., Keller, R. E., & Francone, F. D. (1998). Genetic programming: an introduction (Vol. 1): Morgan Kaufmann San Francisco. Binitha, S., & Sathya, S. S. (2012). A survey of bio inspired optimization algorithms. International Journal of Soft Computing and Engineering, 2(2), 137-151. Brabazon, A. (2008). Natural computing in computational finance (Vol. 1): Springer Science & Business Media. Burke, E., Bykov, Y., & Hirst, J. (2007). Great Deluge Algorithm for Protein Structure Prediction. Burke, E., Bykov, Y., Newall, J., & Petrovic, S. (2003). A time-predefined approach to course timetabling. Yugoslav Journal of Operations Research ISSN: 0354-0243 EISSN: 2334-6043, 13(2). Camazine, S., & Sneyd, J. (1991). A model of collective nectar source selection by honey bees: self-organization through simple rules. Journal of theoretical Biology, 149(4), 547-571. Chau, C., Kwong, S., Diu, C., & Fahrner, W. (1997). Optimization of HMM by a genetic algorithm. Paper presented at the Acoustics, Speech, and Signal Processing, 1997. ICASSP-97., 1997 IEEE International Conference on. Crawford, C., & Krebs, D. L. (2013). Handbook of evolutionary psychology: Ideas, issues, and applications: Psychology Press. Cuevas, E., & Sossa, H. (2013). A comparison of nature inspired algorithms for multi-threshold image segmentation. Expert systems with applications, 40(4), 1213-1219. Di Caro, G., Ducatelle, F., Gambardella, L. M., & Dorigo, M. (2005). AntHocNet: an adaptive nature-inspired algorithm for routing in mobile ad hoc networks. European Transactions on Telecommunications, 16(5), 443-455. Domínguez, J., & Alba, E. (2011). Ethane: a heterogeneous parallel search algorithm for heterogeneous platforms. arXiv preprint arXiv:1105.5900. Dorigo, M., Birattari, M., & Stützle, T. (2006). Ant colony optimization. Computational Intelligence Magazine, IEEE, 1(4), 28-39. Dorigo, M., Caro, G. D., & Gambardella, L. M. (1999). Ant algorithms for discrete optimization. Artificial life, 5(2), 137-172. Dueck, G. (1993). New optimization heuristics: the great deluge algorithm and the record-to-record travel. Journal of Computational physics, 104(1), 86-92. Farmer, W. M., Guttman, J. D., & Thayer, F. J. (1993). IMPS: An interactive mathematical proof system. Journal of Automated Reasoning, 11(2), 213-248. Fister, I., Yang, X.-S., & Brest, J. (2013). A comprehensive review of firefly algorithms. Swarm and Evolutionary Computation, 13, 34-46. Forsythe, G. E., & Wasow, W. R. (1960). Finite-difference methods for partial differential equations. Galbally, J., Fierrez, J., & Ortega-Garcia, J. (2007). Bayesian hill-climbing attack and its application to signature verification Advances in Biometrics (pp. 386-395): Springer. Giannakouris, G., Vassiliadis, V., & Dounias, G. (2010). Experimental study on a hybrid nature-inspired algorithm for financial portfolio optimization Artificial Intelligence: Theories, Models and Applications (pp. 101-111): Springer. Gutjahr, W. J. (2003). A converging ACO algorithm for stochastic combinatorial optimization Stochastic algorithms: Foundations and applications (pp. 10-25): Springer. Halambi, A., Grun, P., Ganesh, V., Khare, A., Dutt, N., & Nicolau, A. (2008). EXPRESSION: A language for architecture exploration through compiler/simulator retargetability. Paper presented at the Design, Automation, and Test in Europe. Hassan, M. H., & Muniyandi, R. C. (2017). An Improved Hybrid Technique for Energy and Delay Routing in Mobile Ad-Hoc Networks. International Journal of Applied Engineering Research, 12(1), 134-139. Hoffmann, J. (2010). A heuristic for domain independent planning and its use in an enforced hill-climbing algorithm Foundations of Intelligent Systems (pp. 216-227): Springer. Karaboga, D., & Akay, B. (2009). A survey: algorithms simulating bee swarm intelligence. Artificial Intelligence Review, 31(1-4), 61-85. Karaboga, D., Akay, B., & Ozturk, C. (2007). Artificial bee colony (ABC) optimization algorithm for training feed-forward neural networks Modeling decisions for artificial intelligence (pp. 318-329): Springer. Karaboga, D., & Aslan, S. (2015). A new emigrant creation strategy for parallel Artificial Bee Colony algorithm. Paper presented at the 2015 9th International Conference on Electrical and Electronics Engineering (ELECO). Karaboga, D., & Basturk, B. (2007). A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. Journal of global optimization, 39(3), 459-471. Karaboga, D., Gorkemli, B., Ozturk, C., & Karaboga, N. (2014). A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artificial Intelligence Review, 42(1), 21-57. Karaboga, D., & Ozturk, C. (2009). Neural networks training by artificial bee colony algorithm on pattern classification. Neural Network World, 19(3), 279. Kefi, S., Rokbani, N., Krömer, P., & Alimi, A. M. (2015). A New Ant Supervised-PSO Variant Applied to Traveling Salesman Problem. Paper presented at the Hybrid Intelligent Systems: 15th International Conference HIS 2015 on Hybrid Intelligent Systems, Seoul, South Korea, November 16-18, 2015. Kennedy, J. (2010). Particle swarm optimization Encyclopedia of Machine Learning (pp. 760-766): Springer. Kifah, S., & Abdullah, S. (2015). An adaptive non-linear great deluge algorithm for the patient-admission problem. Information Sciences, 295, 573-585. Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983). Optimization by simulated annealing. science, 220(4598), 671-680. Kumbharana, N., & Pandey, G. M. (2013). A Comparative Study of ACO, GA and SA for Solving Travelling Salesman Problem. International Journal of Societal Applications of Computer Science, 2(2), 224-228. Kunna, M. A., Kadir, T. A. A., Jaber, A. S., & Odili, J. B. (2015). Large-Scale Kinetic Parameter Identification of Metabolic Network Model of E. coli Using PSO. Advances in Bioscience and Biotechnology, 6(02), 120. Lagarias, J. C., Reeds, J. A., Wright, M. H., & Wright, P. E. (1998). Convergence properties of the Nelder--Mead simplex method in low dimensions. SIAM Journal on optimization, 9(1), 112-147. Langeveld, J., & Engelbrecht, A. P. (2011). A generic set-based particle swarm optimization algorithm. Paper presented at the International conference on swarm intelligence, ICSI. Ledesma, S., Aviña, G., & Sanchez, R. (2008). Practical considerations for simulated annealing implementation. Simulated Annealing, 20, 401-420. Liu, J., Zhu, H., Ma, Q., Zhang, L., & Xu, H. (2015). An Artificial Bee Colony algorithm with guide of global & local optima and asynchronous scaling factors for numerical optimization. Applied Soft Computing, 37, 608-618. Lobo, F. G., Lima, C. F., & Michalewicz, Z. (2007). Parameter setting in evolutionary algorithms (Vol. 54): Springer Science & Business Media. Manjarres, D., Landa-Torres, I., Gil-Lopez, S., Del Ser, J., Bilbao, M. N., Salcedo-Sanz, S., & Geem, Z. W. (2013). A survey on applications of the harmony search algorithm. Engineering Applications of Artificial Intelligence, 26(8), 1818-1831. Mcmullan, P. (2007). An extended implementation of the great deluge algorithm for course timetabling Computational Science–ICCS 2007 (pp. 538-545): Springer. Mehrabian, A. R., & Lucas, C. (2006). A novel numerical optimization algorithm inspired from weed colonization. Ecological informatics, 1(4), 355-366. Meshram, P., & Kanojiya, R. G. (2012). Tuning of PID controller using Ziegler-Nichols method for speed control of DC motor. Paper presented at the Advances in Engineering, Science and Management (ICAESM), 2012 International Conference on. Mezmaz, M., Melab, N., & Talbi, E.-G. (2006). Using the multi-start and island models for parallel multi-objective optimization on the computational grid. Paper presented at the e-Science and Grid Computing, 2006. e-Science'06. Second IEEE International Conference on. Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Grey wolf optimizer. Advances in Engineering Software, 69, 46-61. Nagpure, H., & Raja, R. The Applications Survey on Bee Colony Optimization. Nahas, N., Kadi, D. A., & El Fath, M. N. (2010). Iterated great deluge for the dynamic facility layout problem: CIRRELT. Nozohour-leilabady, B., & Fazelabdolabadi, B. (2015). On the application of Artificial Bee Colony (ABC) algorithm for optimization of well placements in fractured reservoirs; efficiency comparison with the Particle Swarm Optimization (PSO) methodology. Petroleum. Odili, J. B. (2013). Application of Ant Colony Optimization to Solving the Traveling Salesman's Problem. Science Journal of Electrical & Electronic Engineering, 2013. Odili, J. B., & Kahar, M. N. M. (2015a). African Buffalo Optimization (ABO): a New Meta-Heuristic Algorithm. Journal of Advanced & Applied Sciences, 03(03), 101-106. Odili, J. B., & Kahar, M. N. M. (2015b). Numerical Function Optimization Solutions Using the African Buffalo Optimization Algorithm (ABO). British Journal of Mathematics & Computer Science, 10(1), 1-12. Odili, J. B., & Kahar, M. N. M. ( 2016). African Buffalo Optimization. International Journal of Software Engineering & Computer Systems, 2, 28-50. doi:http://dx.doi.org/10.15282/ijsecs.2.2016.1.0014 Odili, J. B., & Mohmad Kahar, M. N. (2016a). African Buffalo Optimization Approach to the Design of PID Controller in Automatic Voltage Regulator System. National Conference for Postgraduate Research, Universiti Malaysia Pahang, September, 2016, 641-648. Odili, J. B., & Mohmad Kahar, M. N. (2016b). Solving the Traveling Salesman's Problem Using the African Buffalo Optimization. Computational Intelligence and Neuroscience, 2016, 1-12. Odili, J. B., Mohmad Kahar, M. N., & Noraziah, A., Odili Esther Abiodun (2016). African Buffalo Optimization and the Randomized Insertion Algorithm for the Asymmetric Travelling Salesman’s Problems Journal of Theoretical and Applied Information Technology, 87(3), 356-364. Olafsson, S. (2006). Metaheuristics. Handbooks in operations research and management science, 13, 633-654. Pereira, G. (2011). Particle Swarm Optimization. INESCID and Instituto Superior Tecnico, Porto Salvo, Portugal, gpereira@ gaips. inesc-id. pt, Verified email at gaips. inesc-id. pt, April, 15. Peri, D., & Tinti, F. (2012). A multistart gradient-based algorithm with surrogate model for global optimization. Communications in Applied and Industrial Mathematics, 3(1). Perkins, S., Lacker, K., & Theiler, J. (2003). Grafting: Fast, incremental feature selection by gradient descent in function space. The Journal of Machine Learning Research, 3, 1333-1356. Pham, D., Ghanbarzadeh, A., Koc, E., Otri, S., Rahim, S., & Zaidi, M. (2011). The Bees Algorithm–A Novel Tool for Complex Optimisation. Paper presented at the Intelligent Production Machines and Systems-2nd I* PROMS Virtual International Conference 3-14 July 2006. Pletcher, R., Minkowycz, W., Sparrow, E., & Schneider, G. (1988). Overview of basic numerical methods. Handbook of Numerical Heat Transfer, 1-88. Poli, R. (2007). An analysis of publications on particle swarm optimization applications. Essex, UK: Department of Computer Science, University of Essex. Qu, Z., & Mo, H. (2011). Research of hybrid biogeography based optimization and clonal selection algorithm for numerical optimization Advances in Swarm Intelligence (pp. 390-399): Springer. Ridge a't, F., Kudcnko, D., & Kazakov'i, D. (2005). Moving Nature-Inspired Algorithms to Parallel, Asynchronous and Decentralised Environments. Self-Organization and Autonomic Informatics (I), 1, 35. Rudolph, G. (1994). Convergence analysis of canonical genetic algorithms. Neural Networks, IEEE Transactions on, 5(1), 96-101. Schraudolph, N. N., & Belew, R. K. (1992). Dynamic parameter encoding for genetic algorithms. Machine learning, 9(1), 9-21. Selman, B., & Gomes, C. P. (2006). Hill‐climbing Search. Encyclopedia of Cognitive Science. Shi, Y., & Eberhart, R. C. (1999). Empirical study of particle swarm optimization. Paper presented at the Evolutionary Computation, 1999. CEC 99. Proceedings of the 1999 Congress on. Simon, D. (2008). Biogeography-based optimization. Evolutionary Computation, IEEE Transactions on, 12(6), 702-713. Simon, D., Ergezer, M., & Du, D. (2009). Population distributions in biogeography-based optimization algorithms with elitism. Paper presented at the Systems, Man and Cybernetics, 2009. SMC 2009. IEEE International Conference on. Sörensen, K. (2015). Metaheuristics—the metaphor exposed. International Transactions in Operational Research, 22(1), 3-18. Sörensen, K., & Glover, F. W. (2013). Metaheuristics Encyclopedia of operations research and management science (pp. 960-970): Springer. Stützle, T., López‐Ibáñez, M., & Dorigo, M. (2011). A concise overview of applications of ant colony optimization. Wiley Encyclopedia of Operations Research and Management Science. Tanweer, M., Suresh, S., & Sundararajan, N. (2015). Improved SRPSO algorithm for solving CEC 2015 computationally expensive numerical optimization problems. Paper presented at the Evolutionary Computation (CEC), 2015 IEEE Congress on. Teodorović, D., & Dell’Orco, M. (2005). Bee colony optimization–a cooperative learning approach to complex transportation problems. Paper presented at the Advanced OR and AI Methods in Transportation: Proceedings of 16th Mini–EURO Conference and 10th Meeting of EWGT (13-16 September 2005).–Poznan: Publishing House of the Polish Operational and System Research. Tyrrell, A. M., Hollingworth, G., & Smith, S. L. (2001). Evolutionary strategies and intrinsic fault tolerance. Paper presented at the Evolvable Hardware, 2001. Proceedings. The Third NASA/DoD Workshop on. Vassiliadis, V., & Dounias, G. (2009). NATURE–INSPIRED INTELLIGENCE: A REVIEW OF SELECTED METHODS AND APPLICATIONS. International Journal on Artificial Intelligence Tools, 18(04), 487-516. Venter, G. (2010). Review of optimization techniques. Encyclopedia of aerospace engineering. Wedde, H. F., & Farooq, M. (2005). A performance evaluation framework for nature inspired routing algorithms Applications of Evolutionary Computing (pp. 136-146): Springer. Whitley, D. (1994). A genetic algorithm tutorial. Statistics and computing, 4(2), 65-85. Wu, Y., Xin, Y., & Zhang, Y. (2015). Application of ACO to Vehicle Routing Problems Using Three Strategies. Xi, B., Liu, Z., Raghavachari, M., Xia, C. H., & Zhang, L. (2004). A smart hill-climbing algorithm for application server configuration. Paper presented at the Proceedings of the 13th international conference on World Wide Web. YANG, B., & ZHANG, Z.-k. (2004). Dynamic Characteristic Parameter Setting Method for Human-simulated Intelligent Controller. Information and Control, 33(6), 670-673. Yang, X.-S. (2005). Engineering optimizations via nature-inspired virtual bee algorithms Artificial Intelligence and Knowledge Engineering Applications: A Bioinspired Approach (pp. 317-323): Springer. Yang, X.-S. (2009a). Firefly algorithms for multimodal optimization Stochastic algorithms: foundations and applications (pp. 169-178): Springer. Yang, X.-S. (2009b). Harmony search as a metaheuristic algorithm Music-inspired harmony search algorithm (pp. 1-14): Springer. Yang, X.-S. (2012). Nature-inspired mateheuristic algorithms: success and new challenges. arXiv preprint arXiv:1211.6658. Yang, X.-S., Deb, S., & Fong, S. (2011). Accelerated particle swarm optimization and support vector machine for business optimization and applications Networked digital technologies (pp. 53-66): Springer. Yeomans, J. S., & Yang, X.-S. (2014). Municipal waste management optimisation using a firefly algorithm-driven simulation-optimisation approach. International Journal of Process Management and Benchmarking, 4(4), 363-375. Zielinski, K., & Laur, R. (2007). Adaptive parameter setting for a multi-objective particle swarm optimization algorithm. Paper presented at the IEEE Congress on.Evolutionary Computation, 2007. CEC 2007.