Bacterial foraging optmization algorithm for neural network learning enhancement

Abstract

Backpropagation algorithm is used to solve many real world problems using the concept of Multilayer Perceptron. However, main disadvantages of Backpropagation are its convergence rate is relatively slow, and it is often trapped at the local minima. To solve this problem, in literatures, evolutionary algorithms such as Particle Swarm Optimization algorithm has been applied in feedforward neural network to optimize the learning process in terms of convergence rate and classification accuracy but this process needs longer training time. To provide alternative solution, in this study, Bacteria Foraging Optimization Algorithm has been selected and applied in feedforward neural network to enhance the learning process in terms of convergence rate and classification accuracy. One of the main processes in Bacteria Foraging Optimization algorithm is the chemotactic movement of a virtual bacterium that makes a trial solution of the optimization problem. This process of chemotactic movement is guided to make the learning process of Artificial Neural Network faster. The developed Bacteria Foraging Optimization Algorithm Feedforward Neural Network (BFOANN) is compared against Particle Swarm Optimization Feedforward Neural Network (PSONN). The results show that BFOANN gave better performance in terms of convergence rate and classification accuracy compared to PSONN.