Universiti Teknologi Malaysia Institutional Repository

Particle swarm optimization for neural network learning enhancement

Abdull Hamed, Haza Nuzly (2006) Particle swarm optimization for neural network learning enhancement. Masters thesis, Universiti Teknologi Malaysia, Faculty of Computer Science and Information System.

[img] PDF (Abstract)
[img] PDF (Table of Contents)
[img] PDF (1st Chapter)
[img] PDF (References)


Backpropagation (BP) algorithm is widely used to solve many real world problems by using the concept of Multilayer Perceptron (MLP). However, major disadvantages of BP are its convergence rate is relatively slow and always being trapped at the local minima. To overcome this problem, Genetic Algorithm (GA) has been used to determine optimal value for BP parameters such as learning rate and momentum rate and also for weight optimization. In Backpropagation Neural Network (BPNN), there are many elements to be considered such as the number of input, hidden and output nodes, learning rate, momentum rate, bias, minimum error and activation/transfer functions. All these elements will affect the speed of neural network learning. Although GA is successfully improved BPNN learning, there are still some issues such as longer training time to produce the output and usage of complex functions in selection, crossover and mutation calculation. In this study, the latest optimization algorithm, Particle Swarm Optimization (PSO) is chosen and applied in feedforward neural network to enhance the learning process in terms of convergence rate and classification accuracy. Two programs have been developed; Particle Swarm Optimization Feedforward Neural Network (PSONN) and Genetic Algorithm Backpropagation Neural Network (GANN). The results show that PSONN give promising results in term of convergence rate and classification compared to GANN.

Item Type:Thesis (Masters)
Additional Information:Thesis (Master of Science (Computer Science)) - Universiti Teknologi Malaysia, 2006; Supervisor : Assoc. Prof. Dr. Siti Mariyam Hj Shamsuddin
Uncontrolled Keywords:Particle Swarm Optimization (PSO), backpropagation (BP) algorithm, genetic algorithm (GA), neural network
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions:Computer Science and Information System (Formerly known)
ID Code:5381
Deposited By: Ms Zalinda Shuratman
Deposited On:07 Apr 2008 06:22
Last Modified:24 Oct 2013 01:26

Repository Staff Only: item control page