Analysis of facial emotion expression in eating occasions using deep learning
<div><p>Eating is experienced as an emotional social activity in any culture. There are factors that influence the emotions felt during food consumption. The emotion felt while eating has a significant impact on our lives and affects different health conditions such as obesity. In additi...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | , |
| منشور في: |
2023
|
| الموضوعات: | |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513533723541504 |
|---|---|
| author | Elif Yildirim (17725965) |
| author2 | Fatma Patlar Akbulut (17725968) Cagatay Catal (6897842) |
| author2_role | author author |
| author_facet | Elif Yildirim (17725965) Fatma Patlar Akbulut (17725968) Cagatay Catal (6897842) |
| author_role | author |
| dc.creator.none.fl_str_mv | Elif Yildirim (17725965) Fatma Patlar Akbulut (17725968) Cagatay Catal (6897842) |
| dc.date.none.fl_str_mv | 2023-03-22T03:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1007/s11042-023-15008-6 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/Analysis_of_facial_emotion_expression_in_eating_occasions_using_deep_learning/24934947 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Built environment and design Architecture Information and computing sciences Software engineering Emotion recognition Affective computing Food Deep learning |
| dc.title.none.fl_str_mv | Analysis of facial emotion expression in eating occasions using deep learning |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <div><p>Eating is experienced as an emotional social activity in any culture. There are factors that influence the emotions felt during food consumption. The emotion felt while eating has a significant impact on our lives and affects different health conditions such as obesity. In addition, investigating the emotion during food consumption is considered a multidisciplinary problem ranging from neuroscience to anatomy. In this study, we focus on evaluating the emotional experience of different participants during eating activities and aim to analyze them automatically using deep learning models. We propose a facial expression-based prediction model to eliminate user bias in questionnaire-based assessment systems and to minimize false entries to the system. We measured the neural, behavioral, and physical manifestations of emotions with a mobile app and recognize emotional experiences from facial expressions. In this research, we used three different situations to test whether there could be any factor other than the food that could affect a person’s mood. We asked users to watch videos, listen to music or do nothing while eating. This way we found out that not only food but also external factors play a role in emotional change. We employed three Convolutional Neural Network (CNN) architectures, fine-tuned VGG16, and Deepface to recognize emotional responses during eating. The experimental results demonstrated that the fine-tuned VGG16 provides remarkable results with an overall accuracy of 77.68% for recognizing the four emotions. This system is an alternative to today’s survey-based restaurant and food evaluation systems.</p><p> </p></div><h2>Other Information</h2> <p> Published in: Multimedia Tools and Applications<br> License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1007/s11042-023-15008-6" target="_blank">https://dx.doi.org/10.1007/s11042-023-15008-6</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_37c5fa74ab255c2db1e98b6bd6e7e1cd |
| identifier_str_mv | 10.1007/s11042-023-15008-6 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/24934947 |
| publishDate | 2023 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | Analysis of facial emotion expression in eating occasions using deep learningElif Yildirim (17725965)Fatma Patlar Akbulut (17725968)Cagatay Catal (6897842)Built environment and designArchitectureInformation and computing sciencesSoftware engineeringEmotion recognitionAffective computingFoodDeep learning<div><p>Eating is experienced as an emotional social activity in any culture. There are factors that influence the emotions felt during food consumption. The emotion felt while eating has a significant impact on our lives and affects different health conditions such as obesity. In addition, investigating the emotion during food consumption is considered a multidisciplinary problem ranging from neuroscience to anatomy. In this study, we focus on evaluating the emotional experience of different participants during eating activities and aim to analyze them automatically using deep learning models. We propose a facial expression-based prediction model to eliminate user bias in questionnaire-based assessment systems and to minimize false entries to the system. We measured the neural, behavioral, and physical manifestations of emotions with a mobile app and recognize emotional experiences from facial expressions. In this research, we used three different situations to test whether there could be any factor other than the food that could affect a person’s mood. We asked users to watch videos, listen to music or do nothing while eating. This way we found out that not only food but also external factors play a role in emotional change. We employed three Convolutional Neural Network (CNN) architectures, fine-tuned VGG16, and Deepface to recognize emotional responses during eating. The experimental results demonstrated that the fine-tuned VGG16 provides remarkable results with an overall accuracy of 77.68% for recognizing the four emotions. This system is an alternative to today’s survey-based restaurant and food evaluation systems.</p><p> </p></div><h2>Other Information</h2> <p> Published in: Multimedia Tools and Applications<br> License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1007/s11042-023-15008-6" target="_blank">https://dx.doi.org/10.1007/s11042-023-15008-6</a></p>2023-03-22T03:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1007/s11042-023-15008-6https://figshare.com/articles/journal_contribution/Analysis_of_facial_emotion_expression_in_eating_occasions_using_deep_learning/24934947CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/249349472023-03-22T03:00:00Z |
| spellingShingle | Analysis of facial emotion expression in eating occasions using deep learning Elif Yildirim (17725965) Built environment and design Architecture Information and computing sciences Software engineering Emotion recognition Affective computing Food Deep learning |
| status_str | publishedVersion |
| title | Analysis of facial emotion expression in eating occasions using deep learning |
| title_full | Analysis of facial emotion expression in eating occasions using deep learning |
| title_fullStr | Analysis of facial emotion expression in eating occasions using deep learning |
| title_full_unstemmed | Analysis of facial emotion expression in eating occasions using deep learning |
| title_short | Analysis of facial emotion expression in eating occasions using deep learning |
| title_sort | Analysis of facial emotion expression in eating occasions using deep learning |
| topic | Built environment and design Architecture Information and computing sciences Software engineering Emotion recognition Affective computing Food Deep learning |