Evaluating machine learning technologies for food computing from a data set perspective

<div><p>Food plays an important role in our lives that goes beyond mere sustenance. Food affects behavior, mood, and social life. It has recently become an important focus of multimedia and social media applications. The rapid increase of available image data and the fast evolution of ar...

وصف كامل

محفوظ في:
التفاصيل البيبلوغرافية
المؤلف الرئيسي: Nauman Ullah Gilal (17302714) (author)
مؤلفون آخرون: Khaled Al-Thelaya (17302711) (author), Jumana Khalid Al-Saeed (17725971) (author), Mohamed Abdallah (3073191) (author), Jens Schneider (16885948) (author), James She (17725974) (author), Jawad Hussain Awan (17725977) (author), Marco Agus (8032898) (author)
منشور في: 2023
الموضوعات:
الوسوم: إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
_version_ 1864513533719347200
author Nauman Ullah Gilal (17302714)
author2 Khaled Al-Thelaya (17302711)
Jumana Khalid Al-Saeed (17725971)
Mohamed Abdallah (3073191)
Jens Schneider (16885948)
James She (17725974)
Jawad Hussain Awan (17725977)
Marco Agus (8032898)
author2_role author
author
author
author
author
author
author
author_facet Nauman Ullah Gilal (17302714)
Khaled Al-Thelaya (17302711)
Jumana Khalid Al-Saeed (17725971)
Mohamed Abdallah (3073191)
Jens Schneider (16885948)
James She (17725974)
Jawad Hussain Awan (17725977)
Marco Agus (8032898)
author_role author
dc.creator.none.fl_str_mv Nauman Ullah Gilal (17302714)
Khaled Al-Thelaya (17302711)
Jumana Khalid Al-Saeed (17725971)
Mohamed Abdallah (3073191)
Jens Schneider (16885948)
James She (17725974)
Jawad Hussain Awan (17725977)
Marco Agus (8032898)
dc.date.none.fl_str_mv 2023-09-19T03:00:00Z
dc.identifier.none.fl_str_mv 10.1007/s11042-023-16513-4
dc.relation.none.fl_str_mv https://figshare.com/articles/journal_contribution/Evaluating_machine_learning_technologies_for_food_computing_from_a_data_set_perspective/24934953
dc.rights.none.fl_str_mv CC BY 4.0
info:eu-repo/semantics/openAccess
dc.subject.none.fl_str_mv Built environment and design
Architecture
Information and computing sciences
Software engineering
Food computing
Food data sets
Applications
Food recognition
Food classification
Caloric estimation
Machine learning
Deep learning
dc.title.none.fl_str_mv Evaluating machine learning technologies for food computing from a data set perspective
dc.type.none.fl_str_mv Text
Journal contribution
info:eu-repo/semantics/publishedVersion
text
contribution to journal
description <div><p>Food plays an important role in our lives that goes beyond mere sustenance. Food affects behavior, mood, and social life. It has recently become an important focus of multimedia and social media applications. The rapid increase of available image data and the fast evolution of artificial intelligence, paired with a raised awareness of people’s nutritional habits, have recently led to an emerging field attracting significant attention, called food computing, aimed at performing automatic food analysis. Food computing benefits from technologies based on modern machine learning techniques, including deep learning, deep convolutional neural networks, and transfer learning. These technologies are broadly used to address emerging problems and challenges in food-related topics, such as food recognition, classification, detection, estimation of calories and food quality, dietary assessment, food recommendation, etc. However, the specific characteristics of food image data, like visual heterogeneity, make the food classification task particularly challenging. To give an overview of the state of the art in the field, we surveyed the most recent machine learning and deep learning technologies used for food classification with a particular focus on data aspects. We collected and reviewed more than 100 papers related to the usage of machine learning and deep learning for food computing tasks. We analyze their performance on publicly available state-of-art food data sets and their potential for usage in multimedia food-related applications for various needs (communication, leisure, tourism, blogging, reverse engineering, etc.). In this paper, we perform an extensive review and categorization of available data sets: to this end, we developed and released an open web resource in which the most recent existing food data sets are collected and mapped to the corresponding geographical regions. Although artificial intelligence methods can be considered mature enough to be used in basic food classification tasks, our analysis of the state-of-the-art reveals that challenges related to the application of this technology need to be addressed. These challenges include, among others: poor representation of regional gastronomy, incorporation of adaptive learning schemes, and reverse engineering for automatic food creation and replication.</p><p> </p></div><h2>Other Information</h2> <p> Published in: Multimedia Tools and Applications<br> License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1007/s11042-023-16513-4" target="_blank">https://dx.doi.org/10.1007/s11042-023-16513-4</a></p>
eu_rights_str_mv openAccess
id Manara2_c5f87e080d6f52c80009b4189ffd8a7d
identifier_str_mv 10.1007/s11042-023-16513-4
network_acronym_str Manara2
network_name_str Manara2
oai_identifier_str oai:figshare.com:article/24934953
publishDate 2023
repository.mail.fl_str_mv
repository.name.fl_str_mv
repository_id_str
rights_invalid_str_mv CC BY 4.0
spelling Evaluating machine learning technologies for food computing from a data set perspectiveNauman Ullah Gilal (17302714)Khaled Al-Thelaya (17302711)Jumana Khalid Al-Saeed (17725971)Mohamed Abdallah (3073191)Jens Schneider (16885948)James She (17725974)Jawad Hussain Awan (17725977)Marco Agus (8032898)Built environment and designArchitectureInformation and computing sciencesSoftware engineeringFood computingFood data setsApplicationsFood recognitionFood classificationCaloric estimationMachine learningDeep learning<div><p>Food plays an important role in our lives that goes beyond mere sustenance. Food affects behavior, mood, and social life. It has recently become an important focus of multimedia and social media applications. The rapid increase of available image data and the fast evolution of artificial intelligence, paired with a raised awareness of people’s nutritional habits, have recently led to an emerging field attracting significant attention, called food computing, aimed at performing automatic food analysis. Food computing benefits from technologies based on modern machine learning techniques, including deep learning, deep convolutional neural networks, and transfer learning. These technologies are broadly used to address emerging problems and challenges in food-related topics, such as food recognition, classification, detection, estimation of calories and food quality, dietary assessment, food recommendation, etc. However, the specific characteristics of food image data, like visual heterogeneity, make the food classification task particularly challenging. To give an overview of the state of the art in the field, we surveyed the most recent machine learning and deep learning technologies used for food classification with a particular focus on data aspects. We collected and reviewed more than 100 papers related to the usage of machine learning and deep learning for food computing tasks. We analyze their performance on publicly available state-of-art food data sets and their potential for usage in multimedia food-related applications for various needs (communication, leisure, tourism, blogging, reverse engineering, etc.). In this paper, we perform an extensive review and categorization of available data sets: to this end, we developed and released an open web resource in which the most recent existing food data sets are collected and mapped to the corresponding geographical regions. Although artificial intelligence methods can be considered mature enough to be used in basic food classification tasks, our analysis of the state-of-the-art reveals that challenges related to the application of this technology need to be addressed. These challenges include, among others: poor representation of regional gastronomy, incorporation of adaptive learning schemes, and reverse engineering for automatic food creation and replication.</p><p> </p></div><h2>Other Information</h2> <p> Published in: Multimedia Tools and Applications<br> License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1007/s11042-023-16513-4" target="_blank">https://dx.doi.org/10.1007/s11042-023-16513-4</a></p>2023-09-19T03:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1007/s11042-023-16513-4https://figshare.com/articles/journal_contribution/Evaluating_machine_learning_technologies_for_food_computing_from_a_data_set_perspective/24934953CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/249349532023-09-19T03:00:00Z
spellingShingle Evaluating machine learning technologies for food computing from a data set perspective
Nauman Ullah Gilal (17302714)
Built environment and design
Architecture
Information and computing sciences
Software engineering
Food computing
Food data sets
Applications
Food recognition
Food classification
Caloric estimation
Machine learning
Deep learning
status_str publishedVersion
title Evaluating machine learning technologies for food computing from a data set perspective
title_full Evaluating machine learning technologies for food computing from a data set perspective
title_fullStr Evaluating machine learning technologies for food computing from a data set perspective
title_full_unstemmed Evaluating machine learning technologies for food computing from a data set perspective
title_short Evaluating machine learning technologies for food computing from a data set perspective
title_sort Evaluating machine learning technologies for food computing from a data set perspective
topic Built environment and design
Architecture
Information and computing sciences
Software engineering
Food computing
Food data sets
Applications
Food recognition
Food classification
Caloric estimation
Machine learning
Deep learning