A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata
A Master of Science thesis in Machine Learning by Ansah Juned Siddiqui entitled, “A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata”, submitted in October 2025. Thesis advisor is Dr. Salam Dhou and thesis co-advisor is Dr. Tamer Shanableh....
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| التنسيق: | doctoralThesis |
| منشور في: |
2025
|
| الموضوعات: | |
| الوصول للمادة أونلاين: | https://hdl.handle.net/11073/33167 |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513440266059776 |
|---|---|
| author | Siddiqui, Ansah Juned |
| author_facet | Siddiqui, Ansah Juned |
| author_role | author |
| dc.contributor.none.fl_str_mv | Dhou, Salam Shanableh, Tamer |
| dc.creator.none.fl_str_mv | Siddiqui, Ansah Juned |
| dc.date.none.fl_str_mv | 2025-10 2026-02-19T10:16:21Z 2026-02-19T10:16:21Z |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | 35.232-2025.62 https://hdl.handle.net/11073/33167 |
| dc.language.none.fl_str_mv | en_US |
| dc.relation.none.fl_str_mv | Master of Science in Machine Learning (MSMLR) |
| dc.subject.none.fl_str_mv | Multimodal Fusion Skin Cancer Deep Learning Transfer Learning |
| dc.title.none.fl_str_mv | A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata |
| dc.type.none.fl_str_mv | info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/doctoralThesis |
| description | A Master of Science thesis in Machine Learning by Ansah Juned Siddiqui entitled, “A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata”, submitted in October 2025. Thesis advisor is Dr. Salam Dhou and thesis co-advisor is Dr. Tamer Shanableh. Soft copy is available (Thesis, Completion Certificate, Approval Signatures, and AUS Archives Consent Form). |
| format | doctoralThesis |
| id | aus_c04e01ad39239583f70791e11e924e31 |
| identifier_str_mv | 35.232-2025.62 |
| language_invalid_str_mv | en_US |
| network_acronym_str | aus |
| network_name_str | aus |
| oai_identifier_str | oai:repository.aus.edu:11073/33167 |
| publishDate | 2025 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| spelling | A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and MetadataSiddiqui, Ansah JunedMultimodal FusionSkin CancerDeep LearningTransfer LearningA Master of Science thesis in Machine Learning by Ansah Juned Siddiqui entitled, “A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata”, submitted in October 2025. Thesis advisor is Dr. Salam Dhou and thesis co-advisor is Dr. Tamer Shanableh. Soft copy is available (Thesis, Completion Certificate, Approval Signatures, and AUS Archives Consent Form).Skin cancer classification is a critical task where artificial intelligence (AI) can enhance diagnostic accuracy for both binary and multi-class classification. This research proposes a multimodal AI- driven framework to classify skin cancer lesions using dermoscopic images, clinical images, and patient metadata. By leveraging the MRA-MIDAS: Multimodal Image Dataset for AI-based Skin Cancer, this thesis aims to build a comprehensive model that is able to classify the patient cases into malignant or benign and further into specific malignant and benign classes. The objective of this thesis is achieved through developing an effective fusion strategy that captures complementary information from multiple modalities to improve both binary and multi-class classification performance. A major challenge in this task is handling varying image resolutions, which can impact feature consistency across modalities. To address this issue, the study introduces a novel region-of- interest (ROI) extraction method using object detection and feature matching techniques for precise spatial alignment. Additionally, various multimodal fusion strategies—early, intermediate, and late fusion are explored to determine the optimal approach for integrating tabular and image data. The experimental setup includes standalone image classification using Convolutional Neural Networks(CNN), metadata-based classification using classical machine learning algorithms, and multiple fusion techniques to assess their impact on overall classification performance. Both binary and multi-class classification tasks are conducted and evaluated. For binary classification, the late- fusion multimodal approach combining images and metadata with EfficientNetB7 and weighted averaging achieved the best performance, reaching an accuracy of 79.19%. For multi-class classification, the multimodal EfficientNet framework demonstrated strong results, with an accuracy of 90.3% for the malignant classifier (five classes), 71.91% for the benign classifier (six classes) and 70.5% for the unified classifier (11 classes). By systematically analyzing the effectiveness of various fusion approaches, this thesis showed that late fusion with weighted averaging was the most promising strategy, with EfficientNet-based models yielding the best overall performance. The malignant classifier achieved the highest accuracy, suggesting that malignant subtypes may possess more consistent visual features making classification easier as compared to the initial binary classification.College of EngineeringDepartment of Computer Science and EngineeringMaster of Science in Machine Learning (MSMLR)Dhou, SalamShanableh, Tamer2026-02-19T10:16:21Z2026-02-19T10:16:21Z2025-10info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisapplication/pdf35.232-2025.62https://hdl.handle.net/11073/33167en_USMaster of Science in Machine Learning (MSMLR)oai:repository.aus.edu:11073/331672026-02-20T08:20:19Z |
| spellingShingle | A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata Siddiqui, Ansah Juned Multimodal Fusion Skin Cancer Deep Learning Transfer Learning |
| status_str | publishedVersion |
| title | A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata |
| title_full | A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata |
| title_fullStr | A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata |
| title_full_unstemmed | A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata |
| title_short | A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata |
| title_sort | A Fusion-Based Approach for Skin Cancer Detection Combining Clinical Images, Dermoscopic Images, and Metadata |
| topic | Multimodal Fusion Skin Cancer Deep Learning Transfer Learning |
| url | https://hdl.handle.net/11073/33167 |