Linear fusion approach to convolutional neural networks for facial emotion recognition

Facial expression recognition is a challenging problem in the scientific field of computer vision. Several face expression recognition (FER) algorithms are proposed in the field of machine learning, and deep learning to extract expression knowledge from facial representations. Even though numerous a...

Full description

Saved in:
Bibliographic Details
Main Authors: Dudekula, Usen (Author), N., Purnachand (Author)
Format: EJournal Article
Published: Institute of Advanced Engineering and Science, 2022-03-01.
Subjects:
Online Access:Get fulltext
Tags: Add Tag
No Tags, Be the first to tag this record!
LEADER 02716 am a22003013u 4500
001 ijeecs27233_16108
042 |a dc 
100 1 0 |a Dudekula, Usen  |e author 
100 1 0 |e contributor 
700 1 0 |a N., Purnachand  |e author 
245 0 0 |a Linear fusion approach to convolutional neural networks for facial emotion recognition 
260 |b Institute of Advanced Engineering and Science,   |c 2022-03-01. 
500 |a https://ijeecs.iaescore.com/index.php/IJEECS/article/view/27233 
520 |a Facial expression recognition is a challenging problem in the scientific field of computer vision. Several face expression recognition (FER) algorithms are proposed in the field of machine learning, and deep learning to extract expression knowledge from facial representations. Even though numerous algorithms have been examined, several issues like lighting changes, rotations and occlusions. We present an efficient approach to enhance recognition accuracy in this study, advocates transfer learning to fine-tune the parameters of the pre-trained model (VGG19 model ) and non-pre-trained model convolutional neural networks (CNNs) for the task of image classification. The VGG19 network and convolutional network derive two channels of expression related characteristics from the facial grayscale images. The linear fusion algorithm calculates the class by taking an average of each classification decision on training samples of both channels. Final recognition is calculated using convolution neural network architecture followed by a softmax classifier. Seven basic facial emotions (BEs): happiness, surprise, anger, sadness, fear, disgust, and neutral facial expressions can be recognized by the proposed algorithm, The average accuracies for standard data set's "CK+," and "JAFFE," 98.3 % and 92.4%, respectively. Using a deep network with one channel, the proposed algorithm can achieve well comparable performance. 
540 |a Copyright (c) 2022 Institute of Advanced Engineering and Science 
540 |a http://creativecommons.org/licenses/by-nc/4.0 
546 |a eng 
690
690 |a Convolutional neural networks; Deep learning; Machine learning; Transfer learning; Visual geometry group; 
655 7 |a info:eu-repo/semantics/article  |2 local 
655 7 |a info:eu-repo/semantics/publishedVersion  |2 local 
655 7 |2 local 
786 0 |n Indonesian Journal of Electrical Engineering and Computer Science; Vol 25, No 3: March 2022; 1489-1500 
786 0 |n 2502-4760 
786 0 |n 2502-4752 
786 0 |n 10.11591/ijeecs.v25.i3 
787 0 |n https://ijeecs.iaescore.com/index.php/IJEECS/article/view/27233/16108 
856 4 1 |u https://ijeecs.iaescore.com/index.php/IJEECS/article/view/27233/16108  |z Get fulltext