Semi-supervised Clustering of Facial Expressions

A Master of Science thesis in Electrical Engineering by Ahsan Jalal entitled, "Semi-supervised Clustering of Facial Expressions," submitted in November 2017. Thesis advisor is Dr. Usman Tariq. Soft and hard copy available.

Saved in:
Bibliographic Details
Main Author: Jalal, Ahsan (author)
Format: doctoralThesis
Published: 2017
Subjects:
Online Access:http://hdl.handle.net/11073/9159
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1864513441678491648
author Jalal, Ahsan
author_facet Jalal, Ahsan
author_role author
dc.contributor.none.fl_str_mv Tariq, Usman
dc.creator.none.fl_str_mv Jalal, Ahsan
dc.date.none.fl_str_mv 2017-11
2018-01-24T04:51:06Z
2018-01-24T04:51:06Z
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.identifier.none.fl_str_mv 35.232-2017.43
http://hdl.handle.net/11073/9159
dc.language.none.fl_str_mv en_US
dc.subject.none.fl_str_mv Facial expressions
semi-supervised learning
deep convolutional network
consensus clustering
Human face recognition (Computer science)
Machine learning
Neural networks (Computer science)
Computer vision
dc.title.none.fl_str_mv Semi-supervised Clustering of Facial Expressions
dc.type.none.fl_str_mv info:eu-repo/semantics/publishedVersion
info:eu-repo/semantics/doctoralThesis
description A Master of Science thesis in Electrical Engineering by Ahsan Jalal entitled, "Semi-supervised Clustering of Facial Expressions," submitted in November 2017. Thesis advisor is Dr. Usman Tariq. Soft and hard copy available.
format doctoralThesis
id aus_15fb400ab7b9fefe07d9f519e3b2af12
identifier_str_mv 35.232-2017.43
language_invalid_str_mv en_US
network_acronym_str aus
network_name_str aus
oai_identifier_str oai:repository.aus.edu:11073/9159
publishDate 2017
repository.mail.fl_str_mv
repository.name.fl_str_mv
repository_id_str
spelling Semi-supervised Clustering of Facial ExpressionsJalal, AhsanFacial expressionssemi-supervised learningdeep convolutional networkconsensus clusteringHuman face recognition (Computer science)Machine learningNeural networks (Computer science)Computer visionA Master of Science thesis in Electrical Engineering by Ahsan Jalal entitled, "Semi-supervised Clustering of Facial Expressions," submitted in November 2017. Thesis advisor is Dr. Usman Tariq. Soft and hard copy available.Automated facial expressions recognition (FER) is an important area in computer vision and machine learning due to its eminent role in human-machine interaction. FER is key in building intelligent user interfaces, particularly in smart cities. It is also used to enable social robots to naturally interact with humans. However, FER is not trivial as it may vary significantly within different genders, age groups and occasions. Limited availability of the labeled dataset for expression recognition task is another challenge. Therefore, semi-supervised learning algorithm using triplet-loss based deep convolutional neural network is proposed with the motivation to cluster known and unknown facial expressions under unconstrained environment. Faces are detected and aligned from the image dataset and are then used to train various supervised and unsupervised dimensionality reduction methods. Transformed faces in the new dimensions are used for clustering using K-means and consensus clustering. Dimensionality reduction methods that are employed include, principal component analysis, linear discriminant analysis and learning embeddings with deep convolutional neural networks (CNN). The motivation behind using supervised CNN is their ability to learn non-linear transformations in a highly complex feature space. The best results could be found using embeddings that are learned using deep convolution neural networks with consensus clustering method. The novelty of the proposed work is to cluster facial expressions, which were not present while learning the supervised dimensionality reduction methods. Experimental results on two constrained datasets, Multi-PIE face and MMI face datasets, show that the proposed algorithm does not only produce best clustering results on discrete expressions compared to other linear embeddings, but also clusters expressions with different intensities. The proposed algorithm is also applied on a complete unconstrained YouTube dataset and the clustering of different facial behaviors shows that the proposed work can be generalized to non-standard expressions and can learn expression classes from the datasets themselves.College of EngineeringDepartment of Electrical EngineeringMaster of Science in Electrical Engineering (MSEE)Tariq, Usman2018-01-24T04:51:06Z2018-01-24T04:51:06Z2017-11info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisapplication/pdfapplication/pdf35.232-2017.43http://hdl.handle.net/11073/9159en_USoai:repository.aus.edu:11073/91592025-06-26T12:25:44Z
spellingShingle Semi-supervised Clustering of Facial Expressions
Jalal, Ahsan
Facial expressions
semi-supervised learning
deep convolutional network
consensus clustering
Human face recognition (Computer science)
Machine learning
Neural networks (Computer science)
Computer vision
status_str publishedVersion
title Semi-supervised Clustering of Facial Expressions
title_full Semi-supervised Clustering of Facial Expressions
title_fullStr Semi-supervised Clustering of Facial Expressions
title_full_unstemmed Semi-supervised Clustering of Facial Expressions
title_short Semi-supervised Clustering of Facial Expressions
title_sort Semi-supervised Clustering of Facial Expressions
topic Facial expressions
semi-supervised learning
deep convolutional network
consensus clustering
Human face recognition (Computer science)
Machine learning
Neural networks (Computer science)
Computer vision
url http://hdl.handle.net/11073/9159