Differential gradient evolution plus algorithm for constraint optimization problems: A hybrid approach

Muhammad Farhan Tabassum; Sana  Akram; Saadia  Mahmood-ul-Hassan; Rabia  Karim; Parvaiz Ahmad Naik; Muhammad  Farman; Mehmet Yavuz; Mehraj-ud-din  Naik; Hijaz Ahmad

doi:10.11121/ijocta.01.2021.001077

Authors

Muhammad Farhan Tabassum University of Lahore, Pakistan
Sana Akram Lahore Garrison University, Lahore, Pakistan
Saadia Mahmood-ul-Hassan University of Lahore, Pakistan
Rabia Karim University of Lahore, Pakistan
Parvaiz Ahmad Naik Xi’an Jiaotong University, Xi’an, China
Muhammad Farman University of Lahore, Pakistan
Mehmet Yavuz Necmettin Erbakan University, Turkey http://orcid.org/0000-0002-3966-6518
Mehraj-ud-din Naik College of Engineering, Jazan University, Saudi Arabia
Hijaz Ahmad International Telematic University Uninettuno, Roma, Italy

DOI:

https://doi.org/10.11121/ijocta.01.2021.001077

Keywords:

Meta-heuristic algorithms , Hybridization , Differential evolution , Gradient evolution , Constraint optimization problems

Abstract

Optimization for all disciplines is very important and applicable. Optimization has played a key role in practical engineering problems. A novel hybrid meta-heuristic optimization algorithm that is based on Differential Evolution (DE), Gradient Evolution (GE) and Jumping Technique named Differential Gradient Evolution Plus (DGE+) are presented in this paper. The proposed algorithm hybridizes the above-mentioned algorithms with the help of an improvised dynamic probability distribution, additionally provides a new shake off method to avoid premature convergence towards local minima. To evaluate the efficiency, robustness, and reliability of DGE+ it has been applied on seven benchmark constraint problems, the results of comparison revealed that the proposed algorithm can provide very compact, competitive and promising performance.

Downloads

Download data is not yet available.

Author Biographies

Muhammad Farhan Tabassum, University of Lahore, Pakistan

Muhammad Farhan Tabassum is working as Assistant Professor at the University of Lahore, Pakistan and currently pursuing his PhD from UMT Lahore. He has published more than 30 research papers. His research interests are Operations research, Optimization, Numerical analysis, Algorithmic development and Multicriteria decision making. He has more than eight years of teaching experience at the university level and supervised the thesis of M.Phil. Mathematics students.

Sana Akram, Lahore Garrison University, Lahore, Pakistan

Sana Akram is working as Assistant Professor in Lahore Garrison University, Lahore, also doing a Ph.D form UMT Lahore, She published more than 40 research papers. Research field is Graph theory, Operations research, Optimization, Numerical Analysis. He has more than seven year teaching experience at University Level also supervised the thesis of M.Phil Mathematics Students.

Saadia Mahmood-ul-Hassan, University of Lahore, Pakistan

Saadia Hassan is currently working as a senior lecturer at the University of Lahore, Pakistan. After completing her MS in linguistics with nine research publications in stylistics, discourse analysis, sports sciences and physical education and translation analysis. With ample experience of research which she gained as a research scholar at the University of Punjab and co-supervision of more than 5 scholars helped her to enliven her hidden potentials. As a PhD scholar, she has plans to endeavour excellence in the domain of applied linguistics.

Rabia Karim, University of Lahore, Pakistan

Rabia Karim is currently serving as Senior Lecturer at the University of Lahore, Pakistan and teaching sports management, sports modern technology and Sports sociology. She has 4 publications at her credit in different journals. Before devoting herself to this field, she has worked as Manager National Sports Events at the Sports Board Punjab. She has also played a leading role in developing and establishing several Cricket Coaching Academies, both for Girls and Boys, in various cities of Pakistan.

Parvaiz Ahmad Naik, Xi’an Jiaotong University, Xi’an, China

Parvaiz Ahmad Naik received his PhD in Mathematics from Maulana Azad National Institute of Technology, a leading institute of India, in December 2015 and currently working as Assistant Professor at the Department of Applied Mathematics, Xi’an Jiaotong University P. R. China. Earlier, he was a postdoctoral research fellow and worked with Prof. Jian Zu at the school of Mathematics and Statistics, Xi'an Jiaotong University, from December 2018-December 2019. His research interests mainly focus on infectious disease dynamics, fractional mathematical modeling, fractional mathematical theory and method and bifurcation analysis. He has published more than 20 SCI research papers in international repute journals like World Scientific, Elsevier, Springer, American Scientific, Taylor & Francis etc. He has received two young scientist awards (gold medals) for his outstanding research work in mathematical biology. Furthermore, he presided over one scientific research project at the national level from the China Postdoctoral Science Foundation under grant no. 2019M663653.

Muhammad Farman, University of Lahore, Pakistan

Muhammad Farman did his PhD at the University of Lahore, Pakistan. His research field is mathematical biology, Control theory, Numerical analysis. He has more than seven years of teaching and research experience at the university level and supervised the thesis of M.Phil. and PhD Mathematics students. He has published more than 65 research papers in a national and international journal. He completes several projects in fractional order nonlinear dynamical system with the collaboration of global universities.

Mehmet Yavuz, Necmettin Erbakan University, Turkey

Mehmet Yavuz received his PhD in Mathematics from Balıkesir University, Turkey. He visited the University of Exeter, UK. for post-doctoral research in mathematical biology and optimal control theory for a year. He is currently serving as associate professor at Necmettin Erbakan University, Turkey. His research interests mainly focus on infectious disease dynamics, fractional mathematical modeling, fractional mathematical theory and method, optimal control theory and bifurcation analysis. He has published more than 40 research papers in international esteemed journals and he is a reviewer for about seventy international repute journals.

Mehraj-ud-din Naik, College of Engineering, Jazan University, Saudi Arabia

Mehraj-ud-din Naik is currently working as Assistant Professor at the Department of Chemical Engineering, College of Engineering, Jazan University, Saudi Arabia. He received his PhD in Chemical Engineering from Chonbuk National University, South Korea, in August 2009. Besides this, he worked as a postdoctoral research fellow at the Department of Chemical Engineering and Applied Chemistry, Chungnam National University South Korea from September 2009-October 2010 and Department of Physics and Mechanical Engineering, University of Padova, Italy, from January 2011-February 2013. His research interests mainly focus on chemical engineering, catalysis, nanotechnology, nanomaterials, nanoparticles. He has published more than 15 SCI research papers in the journals of international repute and serving as a reviewer to many SCI-indexed journals.

Hijaz Ahmad, International Telematic University Uninettuno, Roma, Italy

Hijaz Ahmad works in a number of mathematical areas, but he is primarily interested in developing new numerical techniques for the solution of differential equations. Recently, he has published many papers in high quality journals on modifications of varaitional iteration algorithm-I, algorithm-II and fractional iteration algorithm. He has Ms in Computational Mathematics from COMSATS University, Pakistan and PhD in Computational Mathematics from the University of Engineering and Technology Peshawar, Pakistan. He is an associate member of Section of Mathematics, Uninettuno University, Rome, Italy. He is a reviewer for at least fifty international journals, and also serves on the editorial boards for many good international journals.

References

Khalilpourazari, S. & Khalilpourazary. S. (2018). Optimization of production time in the multi-pass milling process via a robust grey wolf optimizer. Neural Computing and Applications. 29(12), 1321-1336.

Yang, X.-S. (2010). Nature-inspired metaheuristic algorithms. Luniver press.

Gandomi, A. H., Yang, X.-S. & Alavi, A. H. (2011). Mixed variable structural optimization using firefly algorithm. Computers & Structures. 89(23-24), 2325-2336.

Zhang, L., et al. (2016). A novel hybrid firefly algorithm for global optimization. PloS one. 11(9), e0163230.

Alba, E. & Dorronsoro, B. (2005). The exploration/exploitation tradeoff in dynamic cellular genetic algorithms. IEEE transactions on evolutionary computation. 9(2), 126-142.

Olorunda, O. and Engelbrecht, A. P. (2008). Measuring exploration/exploitation in particle swarms using swarm diversity. in 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

Lozano, M. & García-Martínez, C. (2010). Hybrid metaheuristics with evolutionary algorithms specializing in intensification and diversification: Overview and progress report. Computers & Operations Research. 37(3), 481-497.

Simon, D. (2008). Biogeography-based optimization. IEEE transactions on evolutionary computation. 12(6), 702-713.

Storn, R. (1996). On the usage of differential evolution for function optimization. in Proceedings of North American Fuzzy Information Processing. IEEE.

Beyer, H.-G. & Schwefel, H.-P. (2002). Evolution strategies–a comprehensive introduction. Natural computing. 1(1), 3-52.

Bonabeau, E., Dorigo, M. & Theraulaz, G. (1999). From natural to artificial swarm intelligence. Oxford university press, UK.

Koza, J.R. & J.R. Koza. (1992). Genetic programming: On the programming of computers by means of natural selection. MIT press.

Alatas, B. (2011). Acroa: Artificial chemical reaction optimization algorithm for global optimization. Expert Systems with Applications. 38(10), 13170-13180.

Erol, O. K. & I. Eksin. (2006). A new optimization method: Big bang–big crunch. Advances in Engineering Software. 37(2), 106-111.

Rashedi, E., H. Nezamabadi-Pour, & S. Saryazdi. (2009). Gsa: A gravitational search algorithm. Information sciences. 179(13), 2232-2248.

Kaveh, A. & M. Khayatazad. (2012). A new meta-heuristic method: Ray optimization. Computers & Structures. 112: p. 283-294.

Kirkpatrick, S., C. D. Gelatt, & M. P. Vecchi. (1983). Optimization by simulated annealing. science. 220(4598), 671-680.

Du, H., X. Wu, & J. Zhuang. (2006) Small-world optimization algorithm for function optimization. in International Conference on Natural Computation. Springer.

Evirgen, F., & Yavuz, M. (2018). An alternative approach for nonlinear optimization problem with Caputo-Fabrizio derivative. In ITM Web of Conferences (Vol. 22, p. 01009). EDP Sciences.

Evirgen, F., & Özdemir, N. (2012). A fractional order dynamical trajectory approach for optimization problem with HPM. In Fractional Dynamics and Control (pp. 145-155). Springer, New York, NY.

Evirgen, F. (2017). Conformable Fractional Gradient Based Dynamic System for Constrained Optimization Problem. Acta Physica Polonica A, 132(3), 1066-1069.

Evirgen, F. (2016). Analyze the optimal solutions of optimization problems by means of fractional gradient based system using VIM. An International Journal of Optimization and Control: Theories & Applications (IJOCTA), 6(2), 75-83.

Evirgen, F. (2017). Solution of a Class of Optimization Problems Based on Hyperbolic Penalty Dynamic Framework. Acta Physica Polonica A, 132(3), 1062-1065.

Jumani, T. A., et al. (2020). Jaya optimization algorithm for transient response and stability enhancement of a fractional-order PID based automatic voltage regulator system. Alexandria Engineering Journal, 59(4), 2429-2440.

Al-Dhaifallah, M., et al. (2018). Optimal parameter design of fractional order control based INC-MPPT for PV system. Solar Energy, 159, 650-664.

Bitirgen, R., Hancer, M., & Bayezit, I. (2018). All Stabilizing State Feedback Controller for Inverted Pendulum Mechanism. IFAC-PapersOnLine, 51(4), 346-351.

Stützle, T., et al. (2011). Parameter adaptation in ant colony optimization, in Autonomous search. Springer. 191-215.

Yang, X.-S. (2010). A new metaheuristic bat-inspired algorithm, in Nature inspired cooperative strategies for optimization (nicso 2010). Springer. 65-74.

Lu, X. and Y. Zhou. (2008). A novel global convergence algorithm: Bee collecting pollen algorithm. in International Conference on Intelligent Computing. 2008. Springer.

Singh, H., et al. (2019). A reliable numerical algorithm for the fractional klein-gordon equation. Engineering Transactions. 67(1), 21–34.

Kennedy, J. & R. Eberhart. Particle swarm optimization (pso). in Proc IEEE International Conference on Neural Networks, Perth, Australia. 1995.

Kaveh, A. & V. Mahdavi. (2014). Colliding bodies optimization: A novel meta-heuristic method. Computers & Structures. 139: p. 18-27.

Sadollah, A., et al. (2013). Mine blast algorithm: A new population based algorithm for solving constrained engineering optimization problems. Applied Soft Computing. 13(5), 2592-2612.

Wang, B., C. Liu, & H. Wu. (2014). The research of pattern synthesis of linear antenna array based on seeker optimization algorithm. in 2014 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery. IEEE.

He, S., Q. H. Wu, & J. Saunders. (2009). Group search optimizer: An optimization algorithm inspired by animal searching behavior. IEEE transactions on evolutionary computation. 13(5), 973-990.

Ramezani, F. & Lotfi, S. (2013). Social-based algorithm (sba). Applied Soft Computing. 13(5), 2837-2856.

Lu, Y., et al. (2010). An adaptive chaotic differential evolution for the short-term hydrothermal generation scheduling problem. Energy Conversion and Management. 51(7), 1481-1490.

Lu, Y., et al. (2010). An adaptive hybrid differential evolution algorithm for dynamic economic dispatch with valve-point effects. Expert Systems with Applications. 37(7), 4842-4849.

Chang, L., et al. (2012). A hybrid method based on differential evolution and continuous ant colony optimization and its application on wideband antenna design. Progress in electromagnetics research. 122: p. 105-118.

Abdullah, A., et al. (2013). An evolutionary firefly algorithm for the estimation of nonlinear biological model parameters. PloS one. 8(3), e56310.

Niknam, T., Azizipanah-Abarghooee, R. & Aghaei, J. (2012). A new modified teaching-learning algorithm for reserve constrained dynamic economic dispatch. IEEE Transactions on power systems. 28(2), 749-763.

Bhattacharya, A. and Chattopadhyay, P. K. (2010). Hybrid differential evolution with biogeography-based optimization for solution of economic load dispatch. IEEE Transactions on power systems. 25(4), 1955-1964.

Kuo, R. and Zulvia, F. E. (2015). The gradient evolution algorithm: A new metaheuristic. Information Sciences. 316: p. 246-265.

Bazaraa, M. S., H. D. Sherali, & C. M. Shetty. (2013). Nonlinear programming: Theory and algorithms. John Wiley & Sons.

Wang, S.-K., J.-P. Chiou, & C.-W. Liu. (2007). Non-smooth/non-convex economic dispatch by a novel hybrid differential evolution algorithm. IET Generation, Transmission & Distribution. 1(5), 793-803.

Chiou, J.-P. (2007). Variable scaling hybrid differential evolution for large-scale economic dispatch problems. Electric Power Systems Research. 77(3-4), 212-218.

Storn, R. & K. Price. (1997). Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. Journal of global optimization. 11(4), 341-359.

Kuo, R. & F. E. Zulvia. Cluster analysis using a gradient evolution-based k-means algorithm. in 2016 IEEE Congress on Evolutionary Computation (CEC). 2016. IEEE.

Mezura-Montes, E. & C. A. C. Coello. (2008). An empirical study about the usefulness of evolution strategies to solve constrained optimization problems. International Journal of General Systems. 37(4), 443-473.

Kaveh, A. & S. Talatahari. (2009). A particle swarm ant colony optimization for truss structures with discrete variables. Journal of Constructional Steel Research. 65(8-9), 1558-1568.

Koziel, S. & Z. Michalewicz. (1999). Evolutionary algorithms, homomorphous mappings, and constrained parameter optimization. Evolutionary computation. 7(1), 19-44.

Runarsson, T. P. & X. Yao. (2000). Stochastic ranking for constrained evolutionary optimization. IEEE Transactions on Evolutionary Computation. 4(3), 284-294.

Parsopoulos, K. E. & M. N. Vrahatis. (2005). Unified particle swarm optimization for solving constrained engineering optimization problems. in International conference on natural computation. Springer.

Karaboga, D. & B. Basturk. (2007). Artificial bee colony (abc) optimization algorithm for solving constrained optimization problems. in International fuzzy systems association world congress. Springer.

Akay, B. & D. Karaboga. (2012). Artificial bee colony algorithm for large-scale problems and engineering design optimization. Journal of intelligent manufacturing. 23(4), 1001-1014.

Geem, Z. W., J. H. Kim, & G. V. Loganathan. (2001). A new heuristic optimization algorithm: Harmony search. Simulation. 76(2), 60-68.

Lee, K. S. & Z. W. Geem. (2005). A new meta-heuristic algorithm for continuous engineering optimization: Harmony search theory and practice. Computer Methods in Applied Mechanics and Engineering. 194(36-38), 3902-3933.

Farooq, H. & M. T. Siddique. (2014). A comparative study on user interfaces of interactive genetic algorithm. Procedia Computer Science. 32: p. 45-52.

Amirjanov, A. (2008). Investigation of a changing range genetic algorithm in noisy environments. International journal for numerical methods in engineering. 73(1), 26-46.

Hamida, S. B. & M. Schoenauer. (2002). Aschea: New results using adaptive segregational constraint handling. in Proceedings of the 2002 Congress on Evolutionary Computation CEC'02 (Cat No 02TH8600). IEEE.

Krohling, R. A. & L. dos Santos Coelho. (2006). Coevolutionary particle swarm optimization using gaussian distribution for solving constrained optimization problems. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics). 36(6), 1407-1416.

Coello Coello, C. A. & R. L. Becerra. (2004). Efficient evolutionary optimization through the use of a cultural algorithm. Engineering Optimization. 36(2), 219-236.

Huang, F.-z., L. Wang, & Q. He. (2007). An effective co-evolutionary differential evolution for constrained optimization. Applied Mathematics and Computation. 186(1), 340-356.

Zahara, E. & Y.-T. Kao. (2009). Hybrid nelder–mead simplex search and particle swarm optimization for constrained engineering design problems. Expert Systems with Applications. 36(2), 3880-3886.

Becerra, R. L. & C. A. C. Coello. (2006). Cultured differential evolution for constrained optimization. Computer Methods in Applied Mechanics and Engineering. 195(33-36), 4303-4322.

Muñoz Zavala, A. E., A. H. Aguirre, & E. R. Villa Diharce. (2005). Constrained optimization via particle evolutionary swarm optimization algorithm (peso). in Proceedings of the 7th annual conference on Genetic and evolutionary computation. ACM.

Tessema, B. & G. G. Yen. (2006). A self adaptive penalty function based algorithm for constrained optimization. in 2006 IEEE International Conference on Evolutionary Computation. IEEE.

Lampinen, J. (2002). A constraint handling approach for the differential evolution algorithm. in Proceedings of the 2002 Congress on Evolutionary Computation CEC'02 (Cat No 02TH8600). IEEE.

Fogel, D. B. (1995). A comparison of evolutionary programming and genetic algorithms on selected constrained optimization problems. Simulation. 64(6), 397-404.

Amirjanov, A. (2006). The development of a changing range genetic algorithm. Computer Methods in Applied Mechanics and Engineering. 195(19-22), 2495-2508.

Chootinan, P. & A. Chen. (2006). Constraint handling in genetic algorithms using a gradient-based repair method. Computers & operations research. 33(8), 2263-2281.

Gupta, S., R. Tiwari, & S. B. Nair. (2007). Multi-objective design optimisation of rolling bearings using genetic algorithms. Mechanism and Machine Theory. 42(10), 1418-1443.

Zhang, M., W. Luo, & X. Wang. (2008). Differential evolution with dynamic stochastic selection for constrained optimization. Information Sciences. 178(15), 3043-3074.

Wang, L. & L.-p. Li. (2010). An effective differential evolution with level comparison for constrained engineering design. Structural and Multidisciplinary Optimization. 41(6), 947-963.

Hedar, A.-R. & M. Fukushima. (2006). Derivative-free filter simulated annealing method for constrained continuous global optimization. Journal of global optimization. 35(4), 521-549.

Deb, K. (2000). An efficient constraint handling method for genetic algorithms. Computer Methods in Applied Mechanics and Engineering. 186(2-4), 311-338.

Runarsson, T. P. & X. Yao. (2005). Search biases in constrained evolutionary optimization. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). 35(2), 233-243.

Mezura-Montes, E. & C. A. C. Coello. (2005). A simple multimembered evolution strategy to solve constrained optimization problems. IEEE Transactions on Evolutionary Computation. 9(1), 1-17.

Michalewicz, Z. (1995). Genetic algorithms, numerical optimization, and constraints. in Proceedings of the sixth international conference on genetic algorithms. Citeseer.

Rao, R. V., V. J. Savsani, & D. Vakharia. (2011). Teaching–learning-based optimization: A novel method for constrained mechanical design optimization problems. Computer-Aided Design. 43(3), 303-315.

Wang, Y., et al. (2009). Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique. Structural and Multidisciplinary Optimization. 37(4), 395-413.

de Fátima Araújo, T. & W. Uturbey. (2013). Performance assessment of pso, de and hybrid pso–de algorithms when applied to the dispatch of generation and demand. International Journal of Electrical Power & Energy Systems. 47: p. 205-217.

Liu, H., Z. Cai, & Y. Wang. (2010). Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization. Applied Soft Computing. 10(2), 629-640.

Bracken, J. & G. P. McCormick (1968). Selected applications of nonlinear programming. Research Analysis Corp Mclean.