CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children
<p dir="ltr">Dysgraphia is a neurological disorder that hinders the acquisition process of normal writing skills in children, resulting in poor writing abilities. Poor or underdeveloped writing skills in children can negatively impact their self-confidence and academic growth. This w...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | , , |
| منشور في: |
2023
|
| الموضوعات: | |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513557938307072 |
|---|---|
| author | Jayakanth Kunhoth (14158908) |
| author2 | Somaya Al Maadeed (14151420) Moutaz Saleh (14151402) Younes Akbari (16303286) |
| author2_role | author author author |
| author_facet | Jayakanth Kunhoth (14158908) Somaya Al Maadeed (14151420) Moutaz Saleh (14151402) Younes Akbari (16303286) |
| author_role | author |
| dc.creator.none.fl_str_mv | Jayakanth Kunhoth (14158908) Somaya Al Maadeed (14151420) Moutaz Saleh (14151402) Younes Akbari (16303286) |
| dc.date.none.fl_str_mv | 2023-11-30T00:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1016/j.eswa.2023.120740 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/CNN_feature_and_classifier_fusion_on_novel_transformed_image_dataset_for_dysgraphia_diagnosis_in_children/23498267 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Education Specialist studies in education Information and computing sciences Machine learning Learning disabilities Dysgraphia diagnosis Handwriting Machine learning CNN ensembles CNN feature fusion |
| dc.title.none.fl_str_mv | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p dir="ltr">Dysgraphia is a neurological disorder that hinders the acquisition process of normal writing skills in children, resulting in poor writing abilities. Poor or underdeveloped writing skills in children can negatively impact their self-confidence and academic growth. This work proposes various machine learning methods, including transfer learning via fine-tuning, transfer learning via feature extraction, ensembles of deep convolutional neural network (CNN) models, and fusion of CNN features, to develop a preliminary dysgraphia diagnosis system based on handwritten images. In this work, an existing online dysgraphia dataset is converted into images, encompassing various writing tasks. Transfer learning is applied using a pre-trained DenseNet201 network to develop four distinct CNN models separately trained on word, pseudoword, difficult word, and sentence images. Soft voting and hard voting strategies are employed to ensemble these CNN models. The pre-trained DenseNet201 network is used for CNN feature extraction from each task-specific handwritten image data. The extracted CNN features are then fused in different combinations. Three machine learning algorithms support vector machine (SVM), AdaBoost, and Random forest are employed to assess the performance of the CNN features and fused CNN features. Among the task-specific models, the SVM trained on word data achieved the highest accuracy of 91.7%. In the case of ensemble learning, soft voting ensembles of task-specific CNNs achieved an accuracy of 90.4%. The feature fusion approach substantially improved the classification accuracy, with the SVM trained on fused features from the task specific-data achieving an accuracy of 97.3%. This accuracy surpasses the performance of state-of-the-art methods by 16%.</p><h2>Other Information</h2><p dir="ltr">Published in: Expert Systems with Applications<br>License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="http://dx.doi.org/10.1016/j.eswa.2023.120740" target="_blank">http://dx.doi.org/10.1016/j.eswa.2023.120740</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_9e2236c03775b2ca10282add164a446f |
| identifier_str_mv | 10.1016/j.eswa.2023.120740 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/23498267 |
| publishDate | 2023 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in childrenJayakanth Kunhoth (14158908)Somaya Al Maadeed (14151420)Moutaz Saleh (14151402)Younes Akbari (16303286)EducationSpecialist studies in educationInformation and computing sciencesMachine learningLearning disabilitiesDysgraphia diagnosisHandwritingMachine learningCNN ensemblesCNN feature fusion<p dir="ltr">Dysgraphia is a neurological disorder that hinders the acquisition process of normal writing skills in children, resulting in poor writing abilities. Poor or underdeveloped writing skills in children can negatively impact their self-confidence and academic growth. This work proposes various machine learning methods, including transfer learning via fine-tuning, transfer learning via feature extraction, ensembles of deep convolutional neural network (CNN) models, and fusion of CNN features, to develop a preliminary dysgraphia diagnosis system based on handwritten images. In this work, an existing online dysgraphia dataset is converted into images, encompassing various writing tasks. Transfer learning is applied using a pre-trained DenseNet201 network to develop four distinct CNN models separately trained on word, pseudoword, difficult word, and sentence images. Soft voting and hard voting strategies are employed to ensemble these CNN models. The pre-trained DenseNet201 network is used for CNN feature extraction from each task-specific handwritten image data. The extracted CNN features are then fused in different combinations. Three machine learning algorithms support vector machine (SVM), AdaBoost, and Random forest are employed to assess the performance of the CNN features and fused CNN features. Among the task-specific models, the SVM trained on word data achieved the highest accuracy of 91.7%. In the case of ensemble learning, soft voting ensembles of task-specific CNNs achieved an accuracy of 90.4%. The feature fusion approach substantially improved the classification accuracy, with the SVM trained on fused features from the task specific-data achieving an accuracy of 97.3%. This accuracy surpasses the performance of state-of-the-art methods by 16%.</p><h2>Other Information</h2><p dir="ltr">Published in: Expert Systems with Applications<br>License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="http://dx.doi.org/10.1016/j.eswa.2023.120740" target="_blank">http://dx.doi.org/10.1016/j.eswa.2023.120740</a></p>2023-11-30T00:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1016/j.eswa.2023.120740https://figshare.com/articles/journal_contribution/CNN_feature_and_classifier_fusion_on_novel_transformed_image_dataset_for_dysgraphia_diagnosis_in_children/23498267CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/234982672023-11-30T00:00:00Z |
| spellingShingle | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children Jayakanth Kunhoth (14158908) Education Specialist studies in education Information and computing sciences Machine learning Learning disabilities Dysgraphia diagnosis Handwriting Machine learning CNN ensembles CNN feature fusion |
| status_str | publishedVersion |
| title | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| title_full | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| title_fullStr | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| title_full_unstemmed | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| title_short | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| title_sort | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| topic | Education Specialist studies in education Information and computing sciences Machine learning Learning disabilities Dysgraphia diagnosis Handwriting Machine learning CNN ensembles CNN feature fusion |