Universiti Teknologi Malaysia Institutional Repository

Learning enhancement of three-term backpropagation network based on elitist multi-objective evolutionary algorithms

Elsayed, Ashraf Osman Ibrahim (2015) Learning enhancement of three-term backpropagation network based on elitist multi-objective evolutionary algorithms. PhD thesis, Universiti Teknologi Malaysia, Faculty of Computing.

[img]
Preview
PDF
975kB

Official URL: http://dms.library.utm.my:8080/vital/access/manage...

Abstract

The pattern classification problem in machine learning algorithms is the task of assigning objects to one of a different predefined group of categories related to that object. Among the successful machine learning methods are Artificial Neural Networks (ANNs), which aim to minimize the error rate of the training data and generate a simple network architecture to obtain a high classification accuracy. However, designing the ANN architecture is difficult due to the complexity of the structure, such as the network structure, number of hidden nodes and adjustment of weights. Therefore, a number of Evolutionary Algorithms (EAs) has been proposed to improve these network complexities. These algorithms are meant to optimize the connection weight, network structure, network error rate and classification accuracy. Nevertheless, these algorithms are implemented to optimize only one objective, despite the importance of executing many objectives simultaneously. Therefore, this study proposes simultaneous learning and structure optimization for designing a Three-term Backpropagation (TBP) network with four variants of Elitist Multi-objective Evolutionary Algorithms (EMOEAs). These include the Elitist Multi-objective Genetic Algorithm (EMOGA), Hybrid Elitist Multi-objective Genetic Algorithm (HEMOGA), Memetic Adaptive Elitist Multi-objective Genetic Algorithm (MAEMOGA) and the Elitist Multi-objective Differential Evolution (EMODE). The proposed methods are developed to evolve towards a Pareto-optimal set that is defined by multi-objective optimization consisting of connection weight, error rate and structural complexity of the network. The proposed methods are tested on binary and multi-class pattern classification problems. The results show that the proposed MAEMOGA and EMODE are better than EMOGA and HEMOGA in obtaining simple network structure and classification accuracy.

Item Type:Thesis (PhD)
Additional Information:Thesis (Ph.D (Sains Komputer)) - Universiti Teknologi Malaysia, 2015; Supervisor : Prof. Dr. Siti Mariyam Shamsuddin
Uncontrolled Keywords:evolutionary algorithms (EAs), three-term backpropagation (TBP)
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions:Computing
ID Code:54893
Deposited By: Fazli Masari
Deposited On:02 Jun 2016 01:41
Last Modified:15 Nov 2020 09:28

Repository Staff Only: item control page