Smartphone-based food recognition system using multiple deep CNN models
<p>People with blindness or low vision utilize mobile assistive tools for various applications such as object recognition, text recognition, etc. Most of the available applications are focused on recognizing generic objects. And they have not addressed the recognition of food dishes and fruit...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | , |
| منشور في: |
2022
|
| الموضوعات: | |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513567562137600 |
|---|---|
| author | Abdulnaser Fakhrou (14151414) |
| author2 | Jayakanth Kunhoth (14158908) Somaya Al Maadeed (14151420) |
| author2_role | author author |
| author_facet | Abdulnaser Fakhrou (14151414) Jayakanth Kunhoth (14158908) Somaya Al Maadeed (14151420) |
| author_role | author |
| dc.creator.none.fl_str_mv | Abdulnaser Fakhrou (14151414) Jayakanth Kunhoth (14158908) Somaya Al Maadeed (14151420) |
| dc.date.none.fl_str_mv | 2022-11-22T21:13:58Z |
| dc.identifier.none.fl_str_mv | 10.1007/s11042-021-11329-6 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/Smartphone-based_food_recognition_system_using_multiple_deep_CNN_models/21597414 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Computer vision and multimedia computation Distributed computing and systems software Computer Networks and Communications Hardware and Architecture Media Technology Software |
| dc.title.none.fl_str_mv | Smartphone-based food recognition system using multiple deep CNN models |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p>People with blindness or low vision utilize mobile assistive tools for various applications such as object recognition, text recognition, etc. Most of the available applications are focused on recognizing generic objects. And they have not addressed the recognition of food dishes and fruit varieties. In this paper, we propose a smartphone-based system for recognizing the food dishes as well as fruits for children with visual impairments. The Smartphone application utilizes a trained deep CNN model for recognizing the food item from the real-time images. Furthermore, we develop a new deep convolutional neural network (CNN) model for food recognition using the fusion of two CNN architectures. The new deep CNN model is developed using the ensemble learning approach. The deep CNN food recognition model is trained on a customized food recognition dataset.The customized food recognition dataset consists of 29 varieties of food dishes and fruits. Moreover, we analyze the performance of multiple state of art deep CNN models for food recognition using the transfer learning approach. The ensemble model performed better than state of art CNN models and achieved a food recognition accuracy of 95.55 % in the customized food dataset. In addition to that, the proposed deep CNN model is evaluated in two publicly available food datasets to display its efficacy for food recognition tasks.</p><h2>Other Information</h2> <p> Published in: Multimedia Tools and Applications<br> License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="http://dx.doi.org/10.1007/s11042-021-11329-6" target="_blank">http://dx.doi.org/10.1007/s11042-021-11329-6</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_2dd23ce81e7271cfd3b95864490bc1e5 |
| identifier_str_mv | 10.1007/s11042-021-11329-6 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/21597414 |
| publishDate | 2022 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | Smartphone-based food recognition system using multiple deep CNN modelsAbdulnaser Fakhrou (14151414)Jayakanth Kunhoth (14158908)Somaya Al Maadeed (14151420)Computer vision and multimedia computationDistributed computing and systems softwareComputer Networks and CommunicationsHardware and ArchitectureMedia TechnologySoftware<p>People with blindness or low vision utilize mobile assistive tools for various applications such as object recognition, text recognition, etc. Most of the available applications are focused on recognizing generic objects. And they have not addressed the recognition of food dishes and fruit varieties. In this paper, we propose a smartphone-based system for recognizing the food dishes as well as fruits for children with visual impairments. The Smartphone application utilizes a trained deep CNN model for recognizing the food item from the real-time images. Furthermore, we develop a new deep convolutional neural network (CNN) model for food recognition using the fusion of two CNN architectures. The new deep CNN model is developed using the ensemble learning approach. The deep CNN food recognition model is trained on a customized food recognition dataset.The customized food recognition dataset consists of 29 varieties of food dishes and fruits. Moreover, we analyze the performance of multiple state of art deep CNN models for food recognition using the transfer learning approach. The ensemble model performed better than state of art CNN models and achieved a food recognition accuracy of 95.55 % in the customized food dataset. In addition to that, the proposed deep CNN model is evaluated in two publicly available food datasets to display its efficacy for food recognition tasks.</p><h2>Other Information</h2> <p> Published in: Multimedia Tools and Applications<br> License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="http://dx.doi.org/10.1007/s11042-021-11329-6" target="_blank">http://dx.doi.org/10.1007/s11042-021-11329-6</a></p>2022-11-22T21:13:58ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1007/s11042-021-11329-6https://figshare.com/articles/journal_contribution/Smartphone-based_food_recognition_system_using_multiple_deep_CNN_models/21597414CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/215974142022-11-22T21:13:58Z |
| spellingShingle | Smartphone-based food recognition system using multiple deep CNN models Abdulnaser Fakhrou (14151414) Computer vision and multimedia computation Distributed computing and systems software Computer Networks and Communications Hardware and Architecture Media Technology Software |
| status_str | publishedVersion |
| title | Smartphone-based food recognition system using multiple deep CNN models |
| title_full | Smartphone-based food recognition system using multiple deep CNN models |
| title_fullStr | Smartphone-based food recognition system using multiple deep CNN models |
| title_full_unstemmed | Smartphone-based food recognition system using multiple deep CNN models |
| title_short | Smartphone-based food recognition system using multiple deep CNN models |
| title_sort | Smartphone-based food recognition system using multiple deep CNN models |
| topic | Computer vision and multimedia computation Distributed computing and systems software Computer Networks and Communications Hardware and Architecture Media Technology Software |