Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks

Genuineness of smiles is of particular interest in the field of human emotions and social interactions. In this work, we develop an experimental protocol to elicit genuine and fake smile expressions on 28 healthy subjects. Then, we assess the type of smile expressions using electroencephalogram (EEG...

وصف كامل

محفوظ في:
التفاصيل البيبلوغرافية
المؤلف الرئيسي: Moussa, Mostafa M. (author)
مؤلفون آخرون: Tariq, Usman (author), Al Shargie, Fares (author), Al Nashash, Hasan (author)
التنسيق: article
منشور في: 2022
الموضوعات:
الوصول للمادة أونلاين:https://hdl.handle.net/11073/33308
الوسوم: إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
_version_ 1864513431884791808
author Moussa, Mostafa M.
author2 Tariq, Usman
Al Shargie, Fares
Al Nashash, Hasan
author2_role author
author
author
author_facet Moussa, Mostafa M.
Tariq, Usman
Al Shargie, Fares
Al Nashash, Hasan
author_role author
dc.creator.none.fl_str_mv Moussa, Mostafa M.
Tariq, Usman
Al Shargie, Fares
Al Nashash, Hasan
dc.date.none.fl_str_mv 2022-08
2026-04-22T10:13:25Z
2026-04-22T10:13:25Z
dc.format.none.fl_str_mv application/pdf
dc.identifier.none.fl_str_mv Moussa, M. M., Tariq, U., Al-Shargie, F., & Al-Nashash, H. (2022). Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks. IEEE Access, 10, 81020–81030. https://doi.org/10.1109/access.2022.3195028
2169-3536
https://hdl.handle.net/11073/33308
10.1109/ACCESS.2022.3195028
dc.language.none.fl_str_mv en
dc.publisher.none.fl_str_mv IEEE
dc.relation.none.fl_str_mv https://doi.org/10.1109/access.2022.3195028
dc.rights.none.fl_str_mv Attribution 4.0 International
http://creativecommons.org/licenses/by/4.0/
dc.subject.none.fl_str_mv Smile
Emotion
Electroencephalogram (EEG)
Convolutional Neural Networks (CNNs)
Machine Learning
dc.title.none.fl_str_mv Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks
dc.type.none.fl_str_mv Peer-Reviewed
Published version
info:eu-repo/semantics/publishedVersion
info:eu-repo/semantics/article
description Genuineness of smiles is of particular interest in the field of human emotions and social interactions. In this work, we develop an experimental protocol to elicit genuine and fake smile expressions on 28 healthy subjects. Then, we assess the type of smile expressions using electroencephalogram (EEG) signals with convolutional neural networks (CNNs). Five different architectures (CNN1, CNN2, CNN3, CNN4, and CNN5) were examined to differentiate between fake and real smiles. We transform the temporal EEG signals into normalized gray-scale images and perform three-way classification to classify fake smiles, genuine smiles, and neutral expressions in the form of subject-dependent classification. We achieved the highest classification accuracy of 90.4% using CNN1 for the full EEG spectrum. Likewise, we achieved classification accuracies of 87.4%, 88.3%, 89.7%, and 90.0% using Beta, Alpha, Theta, and Delta EEG bands respectively. This paper suggests that CNNs models, widely used in image classification problems, can provide an alternative approach for smile detection from physiological signals such as the EEG.
format article
id aus_7c343fda3bc78b0f03406f04360b1293
identifier_str_mv Moussa, M. M., Tariq, U., Al-Shargie, F., & Al-Nashash, H. (2022). Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks. IEEE Access, 10, 81020–81030. https://doi.org/10.1109/access.2022.3195028
2169-3536
10.1109/ACCESS.2022.3195028
language_invalid_str_mv en
network_acronym_str aus
network_name_str aus
oai_identifier_str oai:repository.aus.edu:11073/33308
publishDate 2022
publisher.none.fl_str_mv IEEE
repository.mail.fl_str_mv
repository.name.fl_str_mv
repository_id_str
rights_invalid_str_mv Attribution 4.0 International
http://creativecommons.org/licenses/by/4.0/
spelling Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural NetworksMoussa, Mostafa M.Tariq, UsmanAl Shargie, FaresAl Nashash, HasanSmileEmotionElectroencephalogram (EEG)Convolutional Neural Networks (CNNs)Machine LearningGenuineness of smiles is of particular interest in the field of human emotions and social interactions. In this work, we develop an experimental protocol to elicit genuine and fake smile expressions on 28 healthy subjects. Then, we assess the type of smile expressions using electroencephalogram (EEG) signals with convolutional neural networks (CNNs). Five different architectures (CNN1, CNN2, CNN3, CNN4, and CNN5) were examined to differentiate between fake and real smiles. We transform the temporal EEG signals into normalized gray-scale images and perform three-way classification to classify fake smiles, genuine smiles, and neutral expressions in the form of subject-dependent classification. We achieved the highest classification accuracy of 90.4% using CNN1 for the full EEG spectrum. Likewise, we achieved classification accuracies of 87.4%, 88.3%, 89.7%, and 90.0% using Beta, Alpha, Theta, and Delta EEG bands respectively. This paper suggests that CNNs models, widely used in image classification problems, can provide an alternative approach for smile detection from physiological signals such as the EEG.IEEE2026-04-22T10:13:25Z2026-04-22T10:13:25Z2022-08Peer-ReviewedPublished versioninfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfMoussa, M. M., Tariq, U., Al-Shargie, F., & Al-Nashash, H. (2022). Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks. IEEE Access, 10, 81020–81030. https://doi.org/10.1109/access.2022.31950282169-3536https://hdl.handle.net/11073/3330810.1109/ACCESS.2022.3195028enhttps://doi.org/10.1109/access.2022.3195028Attribution 4.0 Internationalhttp://creativecommons.org/licenses/by/4.0/oai:repository.aus.edu:11073/333082026-04-23T05:25:03Z
spellingShingle Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks
Moussa, Mostafa M.
Smile
Emotion
Electroencephalogram (EEG)
Convolutional Neural Networks (CNNs)
Machine Learning
status_str publishedVersion
title Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks
title_full Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks
title_fullStr Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks
title_full_unstemmed Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks
title_short Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks
title_sort Discriminating Fake and Real Smiles Using Electroencephalogram Signals With Convolutional Neural Networks
topic Smile
Emotion
Electroencephalogram (EEG)
Convolutional Neural Networks (CNNs)
Machine Learning
url https://hdl.handle.net/11073/33308