Learning face similarities for face verification using hybrid convolutional neural networks

Face verification focuses on the task of determining whether two face images belong to the same identity or not. For unrestricted faces in the wild, this is a very challenging task. Besides significant degradation due to images that have large variations in pose, illumination, expression, aging, and...

Full description

Saved in:
Bibliographic Details
Main Authors: Zaman, Fadhlan Hafizhelmi Kamaru (Author), Johari, Juliana (Author), Yassin, Ahmad Ihsan Mohd (Author)
Format: EJournal Article
Published: Institute of Advanced Engineering and Science, 2019-12-01.
Subjects:
Online Access:Get fulltext
Tags: Add Tag
No Tags, Be the first to tag this record!
LEADER 03119 am a22003133u 4500
001 ijeecs20388_13170
042 |a dc 
100 1 0 |a Zaman, Fadhlan Hafizhelmi Kamaru  |e author 
100 1 0 |e contributor 
700 1 0 |a Johari, Juliana  |e author 
700 1 0 |a Yassin, Ahmad Ihsan Mohd  |e author 
245 0 0 |a Learning face similarities for face verification using hybrid convolutional neural networks 
260 |b Institute of Advanced Engineering and Science,   |c 2019-12-01. 
500 |a https://ijeecs.iaescore.com/index.php/IJEECS/article/view/20388 
520 |a Face verification focuses on the task of determining whether two face images belong to the same identity or not. For unrestricted faces in the wild, this is a very challenging task. Besides significant degradation due to images that have large variations in pose, illumination, expression, aging, and occlusions, it also suffers from large-scale ever-expanding data needed to perform one-to-many recognition task. In this paper, we propose a face verification method by learning face similarities using a Convolutional Neural Networks (ConvNet). Instead of extracting features from each face image separately, our ConvNet model jointly extracts relational visual features from two face images in comparison. We train four hybrid ConvNet models to learn how to distinguish similarities between the face pair of four different face portions and join them at top-layer classifier level. We use binary-class classifier at top-layer level to identify the similarity of face pairs which includes a conventional Multi-Layer Perceptron (MLP), Support Vector Machines (SVM), Native Bayes, and another ConvNet. There are 3 face pairing configurations discussed in this paper. Results from experiments using Labeled face in the Wild (LFW) and CelebA datasets indicate that our hybrid ConvNet increases the face verification accuracy by as much as 27% when compared to individual ConvNet approach. We also found that Lateral face pair configuration yields the best LFW test accuracy on a very strict test protocol without any face alignment using MLP as top-layer classifier at 87.89%, which on-par with the state-of-the-arts. We showed that our approach is more flexible in terms of inferencing the learned models on out-of-sample data by testing LFW and CelebA on either model. 
540 |a Copyright (c) 2019 Institute of Advanced Engineering and Science 
540 |a http://creativecommons.org/licenses/by-nc/4.0 
546 |a eng 
690
690 |a Face verification, Face similarities, Unrestricted face, Face recognition, Deep learning 
655 7 |a info:eu-repo/semantics/article  |2 local 
655 7 |a info:eu-repo/semantics/publishedVersion  |2 local 
655 7 |2 local 
786 0 |n Indonesian Journal of Electrical Engineering and Computer Science; Vol 16, No 3: December 2019; 1333-1342 
786 0 |n 2502-4760 
786 0 |n 2502-4752 
786 0 |n 10.11591/ijeecs.v16.i3 
787 0 |n https://ijeecs.iaescore.com/index.php/IJEECS/article/view/20388/13170 
856 4 1 |u https://ijeecs.iaescore.com/index.php/IJEECS/article/view/20388/13170  |z Get fulltext