Convolutional Attention Based Mechanism for Facial Microexpression Recognition
<p dir="ltr">Unanticipated and rapid change in facial expression are micro-expression (ME) that are hard to hide after an emotionally charged event. Facial microexpressions are transient and subtle, making identification challenging. Recognition of MEs are very crucial in the light o...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | , , , , , |
| منشور في: |
2025
|
| الموضوعات: | |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513549647216640 |
|---|---|
| author | Hafiz Khizer bin Talib (20571467) |
| author2 | Kaiwei Xu (822777) Yanlong Cao (4737243) Yuan-Ping Xu (20701244) Zhijie Xu (3929918) Muhammad Zaman (66868) Adnan Akhunzada (20151648) |
| author2_role | author author author author author author |
| author_facet | Hafiz Khizer bin Talib (20571467) Kaiwei Xu (822777) Yanlong Cao (4737243) Yuan-Ping Xu (20701244) Zhijie Xu (3929918) Muhammad Zaman (66868) Adnan Akhunzada (20151648) |
| author_role | author |
| dc.creator.none.fl_str_mv | Hafiz Khizer bin Talib (20571467) Kaiwei Xu (822777) Yanlong Cao (4737243) Yuan-Ping Xu (20701244) Zhijie Xu (3929918) Muhammad Zaman (66868) Adnan Akhunzada (20151648) |
| dc.date.none.fl_str_mv | 2025-01-03T00:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1109/ACCESS.2024.3525151 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/Convolutional_Attention_Based_Mechanism_for_Facial_Microexpression_Recognition/28385687 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Biomedical and clinical sciences Medical biotechnology Engineering Control engineering, mechatronics and robotics Information and computing sciences Artificial intelligence Psychology Applied and developmental psychology Biological psychology Cognitive and computational psychology Attention mechanism CABM-FMER ConvMixer Micro expression recognition Transformers Feature extraction Accuracy Convolutional neural networks Face recognition Optical flow Data mining Training Correlation |
| dc.title.none.fl_str_mv | Convolutional Attention Based Mechanism for Facial Microexpression Recognition |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p dir="ltr">Unanticipated and rapid change in facial expression are micro-expression (ME) that are hard to hide after an emotionally charged event. Facial microexpressions are transient and subtle, making identification challenging. Recognition of MEs are very crucial in the light of personal intention phase identification. Previous studies had challenges recognizing ME due to complicated spatiotemporal linkage in video data. Using the ConvMixer architecture, we Proposed a novel technique for facial microexpression identification based on convolutional attention mechanism. The research uses SAMM, SMIC, and CASME-II are benchmark datasets used to perform experiments. ConvMixer deployed to analyze the SAMM dataset where ConvMixer achieved an amazing 99.73% accuracy, 97.3% precision, 96.5% recall, and 99% F1-Score while 10-fold cross-validation. In addition, we extended our analysis to the CASME-II dataset, where ConvMixer attained an F1-Score of 99.4%, an accuracy of 99.12%, a precision of 98.3%, and a recall of 98.7%. These findings indicate that ConvMixer regularly outperforms other MER architectures, while capturing video specific and dynamic characteristics. ConvMixer architecture are good in capturing both spatial and temporal correlations and extracts spatial information using depthwise convolutions and channel mixing processes. High F1-Score, recall, precision, and accuracy across several datasets demonstrate the robustness and adaptability of the ConvMixer architecture. Finally, our findings show that the Convolutional Attention-Based Mechanism for facial microexpression recognition (CABM-FMER) works effectively for identifying facial MEs.</p><h2>Other Information:</h2><p dir="ltr">Published in: <a href="https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6287639" target="_blank">IEEE Access</a><br>License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://doi.org/10.1109/access.2024.3525151" target="_blank">https://doi.org/10.1109/access.2024.3525151</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_50c4c44522d3e5247de31e1fea2355ca |
| identifier_str_mv | 10.1109/ACCESS.2024.3525151 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/28385687 |
| publishDate | 2025 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | Convolutional Attention Based Mechanism for Facial Microexpression RecognitionHafiz Khizer bin Talib (20571467)Kaiwei Xu (822777)Yanlong Cao (4737243)Yuan-Ping Xu (20701244)Zhijie Xu (3929918)Muhammad Zaman (66868)Adnan Akhunzada (20151648)Biomedical and clinical sciencesMedical biotechnologyEngineeringControl engineering, mechatronics and roboticsInformation and computing sciencesArtificial intelligencePsychologyApplied and developmental psychologyBiological psychologyCognitive and computational psychologyAttention mechanismCABM-FMERConvMixerMicro expression recognitionTransformersFeature extractionAccuracyConvolutional neural networksFace recognitionOptical flowData miningTrainingCorrelation<p dir="ltr">Unanticipated and rapid change in facial expression are micro-expression (ME) that are hard to hide after an emotionally charged event. Facial microexpressions are transient and subtle, making identification challenging. Recognition of MEs are very crucial in the light of personal intention phase identification. Previous studies had challenges recognizing ME due to complicated spatiotemporal linkage in video data. Using the ConvMixer architecture, we Proposed a novel technique for facial microexpression identification based on convolutional attention mechanism. The research uses SAMM, SMIC, and CASME-II are benchmark datasets used to perform experiments. ConvMixer deployed to analyze the SAMM dataset where ConvMixer achieved an amazing 99.73% accuracy, 97.3% precision, 96.5% recall, and 99% F1-Score while 10-fold cross-validation. In addition, we extended our analysis to the CASME-II dataset, where ConvMixer attained an F1-Score of 99.4%, an accuracy of 99.12%, a precision of 98.3%, and a recall of 98.7%. These findings indicate that ConvMixer regularly outperforms other MER architectures, while capturing video specific and dynamic characteristics. ConvMixer architecture are good in capturing both spatial and temporal correlations and extracts spatial information using depthwise convolutions and channel mixing processes. High F1-Score, recall, precision, and accuracy across several datasets demonstrate the robustness and adaptability of the ConvMixer architecture. Finally, our findings show that the Convolutional Attention-Based Mechanism for facial microexpression recognition (CABM-FMER) works effectively for identifying facial MEs.</p><h2>Other Information:</h2><p dir="ltr">Published in: <a href="https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6287639" target="_blank">IEEE Access</a><br>License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://doi.org/10.1109/access.2024.3525151" target="_blank">https://doi.org/10.1109/access.2024.3525151</a></p>2025-01-03T00:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1109/ACCESS.2024.3525151https://figshare.com/articles/journal_contribution/Convolutional_Attention_Based_Mechanism_for_Facial_Microexpression_Recognition/28385687CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/283856872025-01-03T00:00:00Z |
| spellingShingle | Convolutional Attention Based Mechanism for Facial Microexpression Recognition Hafiz Khizer bin Talib (20571467) Biomedical and clinical sciences Medical biotechnology Engineering Control engineering, mechatronics and robotics Information and computing sciences Artificial intelligence Psychology Applied and developmental psychology Biological psychology Cognitive and computational psychology Attention mechanism CABM-FMER ConvMixer Micro expression recognition Transformers Feature extraction Accuracy Convolutional neural networks Face recognition Optical flow Data mining Training Correlation |
| status_str | publishedVersion |
| title | Convolutional Attention Based Mechanism for Facial Microexpression Recognition |
| title_full | Convolutional Attention Based Mechanism for Facial Microexpression Recognition |
| title_fullStr | Convolutional Attention Based Mechanism for Facial Microexpression Recognition |
| title_full_unstemmed | Convolutional Attention Based Mechanism for Facial Microexpression Recognition |
| title_short | Convolutional Attention Based Mechanism for Facial Microexpression Recognition |
| title_sort | Convolutional Attention Based Mechanism for Facial Microexpression Recognition |
| topic | Biomedical and clinical sciences Medical biotechnology Engineering Control engineering, mechatronics and robotics Information and computing sciences Artificial intelligence Psychology Applied and developmental psychology Biological psychology Cognitive and computational psychology Attention mechanism CABM-FMER ConvMixer Micro expression recognition Transformers Feature extraction Accuracy Convolutional neural networks Face recognition Optical flow Data mining Training Correlation |