CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children
Dysgraphia is a neurological disorder that hinders the acquisition process of normal writing skills in children, resulting in poor writing abilities. Poor or underdeveloped writing skills in children can negatively impact their self-confidence and academic growth. This work proposes various machine...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | , , |
| Format: | article |
| Published: |
2023
|
| Subjects: | |
| Online Access: | http://dx.doi.org/10.1016/j.eswa.2023.120740 https://www.sciencedirect.com/science/article/pii/S0957417423012423 http://hdl.handle.net/10576/49665 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1857415087431614464 |
|---|---|
| author | Jayakanth, Kunhoth |
| author2 | Al Maadeed, Somaya Saleh, Moutaz Akbari, Younes |
| author2_role | author author author |
| author_facet | Jayakanth, Kunhoth Al Maadeed, Somaya Saleh, Moutaz Akbari, Younes |
| author_role | author |
| dc.creator.none.fl_str_mv | Jayakanth, Kunhoth Al Maadeed, Somaya Saleh, Moutaz Akbari, Younes |
| dc.date.none.fl_str_mv | 2023-11-26T07:33:46Z 2023-11-30 |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | http://dx.doi.org/10.1016/j.eswa.2023.120740 Kunhoth, J., Al Maadeed, S., Saleh, M., & Akbari, Y. (2023). CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children. Expert Systems with Applications, 120740. 09574174 https://www.sciencedirect.com/science/article/pii/S0957417423012423 http://hdl.handle.net/10576/49665 231 |
| dc.language.none.fl_str_mv | en |
| dc.publisher.none.fl_str_mv | Elsevier |
| dc.rights.none.fl_str_mv | http://creativecommons.org/licenses/by/4.0/ info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Learning disabilities Dysgraphia diagnosis Handwriting Machine learning CNN ensembles CNN feature fusion |
| dc.title.none.fl_str_mv | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| dc.type.none.fl_str_mv | Article info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/article |
| description | Dysgraphia is a neurological disorder that hinders the acquisition process of normal writing skills in children, resulting in poor writing abilities. Poor or underdeveloped writing skills in children can negatively impact their self-confidence and academic growth. This work proposes various machine learning methods, including transfer learning via fine-tuning, transfer learning via feature extraction, ensembles of deep convolutional neural network (CNN) models, and fusion of CNN features, to develop a preliminary dysgraphia diagnosis system based on handwritten images. In this work, an existing online dysgraphia dataset is converted into images, encompassing various writing tasks. Transfer learning is applied using a pre-trained DenseNet201 network to develop four distinct CNN models separately trained on word, pseudoword, difficult word, and sentence images. Soft voting and hard voting strategies are employed to ensemble these CNN models. The pre-trained DenseNet201 network is used for CNN feature extraction from each task-specific handwritten image data. The extracted CNN features are then fused in different combinations. Three machine learning algorithms support vector machine (SVM), AdaBoost, and Random forest are employed to assess the performance of the CNN features and fused CNN features. Among the task-specific models, the SVM trained on word data achieved the highest accuracy of 91.7%. In the case of ensemble learning, soft voting ensembles of task-specific CNNs achieved an accuracy of 90.4%. The feature fusion approach substantially improved the classification accuracy, with the SVM trained on fused features from the task specific-data achieving an accuracy of 97.3%. This accuracy surpasses the performance of state-of-the-art methods by 16%. |
| eu_rights_str_mv | openAccess |
| format | article |
| id | qu_338d08e46a08d12b9ae6ad3198f85e83 |
| identifier_str_mv | Kunhoth, J., Al Maadeed, S., Saleh, M., & Akbari, Y. (2023). CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children. Expert Systems with Applications, 120740. 09574174 231 |
| language_invalid_str_mv | en |
| network_acronym_str | qu |
| network_name_str | Qatar University repository |
| oai_identifier_str | oai:qspace.qu.edu.qa:10576/49665 |
| publishDate | 2023 |
| publisher.none.fl_str_mv | Elsevier |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | http://creativecommons.org/licenses/by/4.0/ |
| spelling | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in childrenJayakanth, KunhothAl Maadeed, SomayaSaleh, MoutazAkbari, YounesLearning disabilitiesDysgraphia diagnosisHandwritingMachine learningCNN ensemblesCNN feature fusionDysgraphia is a neurological disorder that hinders the acquisition process of normal writing skills in children, resulting in poor writing abilities. Poor or underdeveloped writing skills in children can negatively impact their self-confidence and academic growth. This work proposes various machine learning methods, including transfer learning via fine-tuning, transfer learning via feature extraction, ensembles of deep convolutional neural network (CNN) models, and fusion of CNN features, to develop a preliminary dysgraphia diagnosis system based on handwritten images. In this work, an existing online dysgraphia dataset is converted into images, encompassing various writing tasks. Transfer learning is applied using a pre-trained DenseNet201 network to develop four distinct CNN models separately trained on word, pseudoword, difficult word, and sentence images. Soft voting and hard voting strategies are employed to ensemble these CNN models. The pre-trained DenseNet201 network is used for CNN feature extraction from each task-specific handwritten image data. The extracted CNN features are then fused in different combinations. Three machine learning algorithms support vector machine (SVM), AdaBoost, and Random forest are employed to assess the performance of the CNN features and fused CNN features. Among the task-specific models, the SVM trained on word data achieved the highest accuracy of 91.7%. In the case of ensemble learning, soft voting ensembles of task-specific CNNs achieved an accuracy of 90.4%. The feature fusion approach substantially improved the classification accuracy, with the SVM trained on fused features from the task specific-data achieving an accuracy of 97.3%. This accuracy surpasses the performance of state-of-the-art methods by 16%.Elsevier2023-11-26T07:33:46Z2023-11-30Articleinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://dx.doi.org/10.1016/j.eswa.2023.120740Kunhoth, J., Al Maadeed, S., Saleh, M., & Akbari, Y. (2023). CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children. Expert Systems with Applications, 120740.09574174https://www.sciencedirect.com/science/article/pii/S0957417423012423http://hdl.handle.net/10576/49665231enhttp://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:qspace.qu.edu.qa:10576/496652024-07-23T15:52:04Z |
| spellingShingle | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children Jayakanth, Kunhoth Learning disabilities Dysgraphia diagnosis Handwriting Machine learning CNN ensembles CNN feature fusion |
| status_str | publishedVersion |
| title | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| title_full | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| title_fullStr | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| title_full_unstemmed | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| title_short | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| title_sort | CNN feature and classifier fusion on novel transformed image dataset for dysgraphia diagnosis in children |
| topic | Learning disabilities Dysgraphia diagnosis Handwriting Machine learning CNN ensembles CNN feature fusion |
| url | http://dx.doi.org/10.1016/j.eswa.2023.120740 https://www.sciencedirect.com/science/article/pii/S0957417423012423 http://hdl.handle.net/10576/49665 |