Artificial Neural Network Weight Optimization: A Review

Optimizing the weights of Artificial Neural Networks (ANNs) is a great important of a complex task in the research of machine learning due to dependence of its performance to the success of learning process and the training method. This paper reviews the implementation of meta-heuristic algorithms i...

Full description

Saved in:
Bibliographic Details
Main Authors: Nur, Abdirashid Salad (Author), Mohd Radzi, Nor Haizan (Author), Ibrahim, Ashraf Osman (Author)
Format: EJournal Article
Published: Institute of Advanced Engineering and Science, 2014-09-01.
Subjects:
Online Access:Get fulltext
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Optimizing the weights of Artificial Neural Networks (ANNs) is a great important of a complex task in the research of machine learning due to dependence of its performance to the success of learning process and the training method. This paper reviews the implementation of meta-heuristic algorithms in ANNs' weight optimization by studying their advantages and disadvantages giving consideration to some meta-heuristic members such as Genetic algorithim, Particle Swarm Optimization and recently introduced meta-heuristic algorithm called Harmony Search Algorithm (HSA). Also, the application of local search based algorithms to optimize the ANNs weights and their benefits as well as their limitations are briefly elaborated. Finally, a comparison between local search methods and global optimization methods is carried out to speculate the trends in the progresses of ANNs' weight optimization in the current resrearch.
Item Description:https://ijeecs.iaescore.com/index.php/IJEECS/article/view/3826