A Hybrid Approach Based on Genetic Algorithm and Particle Swarm Optimization to Improve Neural Network Classification

Abstract

Artificial Neural Network (ANN) has played a significant role in many areas because of its ability to solve many complex problems that mathematical methods failed to solve. However, it has some shortcomings that lead it to stop working in some cases or decrease the result accuracy. In this research the authors propose a new approach combining particle swarm optimization algorithm (PSO) and genetic algorithm (GA), to increase the classification accuracy of ANN. The proposed approach utilizes the advantages of both PSO and GA to overcome the local minima problem of ANN, which prevents ANN from improving the classification accuracy. The algorithms start with using backpropagation algorithm, then it keeps repeating applying GA followed by PSO until the optimum classification is reached. The proposed approach is domain independent and has been evaluated by applying it using nine datasets with various domains and characteristics. A comparative study has been performed between the authors' proposed approach and other previous approaches, the results show the superiority of our approach.