Dual-stage segmentation and classification framework for skin lesion analysis using deep neural network
<h3>Objective</h3><p dir="ltr">Skin diseases, caused by various pathogens including bacteria, viruses, and fungi, are prevalent globally and significantly affect patients’ physical, emotional, and social well-being. Early and accurate detection of such conditions is criti...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | , , |
| Published: |
2025
|
| Subjects: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1864513533173039104 |
|---|---|
| author | Khadija Manzoor (22565369) |
| author2 | Nauman U Gilal (22565372) Marco Agus (8032898) Jens Schneider (16885948) |
| author2_role | author author author |
| author_facet | Khadija Manzoor (22565369) Nauman U Gilal (22565372) Marco Agus (8032898) Jens Schneider (16885948) |
| author_role | author |
| dc.creator.none.fl_str_mv | Khadija Manzoor (22565369) Nauman U Gilal (22565372) Marco Agus (8032898) Jens Schneider (16885948) |
| dc.date.none.fl_str_mv | 2025-07-13T09:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1177/20552076251351858 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/Dual-stage_segmentation_and_classification_framework_for_skin_lesion_analysis_using_deep_neural_network/30541355 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Engineering Biomedical engineering Health sciences Health services and systems Information and computing sciences Artificial intelligence Skin lesion segmentation deep learning image augmentation skin disease classification skin cancer |
| dc.title.none.fl_str_mv | Dual-stage segmentation and classification framework for skin lesion analysis using deep neural network |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <h3>Objective</h3><p dir="ltr">Skin diseases, caused by various pathogens including bacteria, viruses, and fungi, are prevalent globally and significantly affect patients’ physical, emotional, and social well-being. Early and accurate detection of such conditions is critical to prevent progression, especially in cases of malignant skin lesions. This study aims to develop a dual-stage deep learning framework for the segmentation and classification of skin lesions, addressing challenges such as imbalanced data, lesion variability, and low contrast.</p><h3>Methods</h3><p dir="ltr">We propose a two-phase framework: (i) Precise instance segmentation using U-Net with a Visual Geometry Group (VGG16 encoder) to isolate skin lesions and (ii) classification using EfficientFormer and SwiftFormer networks to evaluate performance on both balanced and imbalanced datasets. Experiments were conducted on three benchmark datasets: Human against machine with 10,000 training images (HAM10000), International Skin Imaging Collaboration (ISIC) 2018, and the newly released ISIC 2024 SLICE-3D dataset. For SLICE-3D, we evaluated both tabular-only and image + metadata fusion approaches using XGBoost classifier and ResNet-based classifier, respectively.</p><h3>Results</h3><p dir="ltr">On the balanced HAM10000 dataset, EfficientFormerV2 achieved 97.11% accuracy, a 97.14% F 1 -score, 96.85% sensitivity, and 96.70% specificity. On the ISIC 2018 dataset, the segmentation model achieved 97.59% accuracy, 89.12% Jaccard index, and 94.24% Dice similarity coefficient. For the ISIC 2024 SLICE-3D challenge, the tabular-only XGBoost classifier achieved a partial area under the receiver operating characteristic curve score of 0.16752, while the image + tabular fusion model achieved a score of 0.15792 using ResNet, demonstrating competitive performance in a highly imbalanced and clinically realistic setting.</p><h3>Conclusion</h3><p dir="ltr">The proposed dual-stage deep learning framework demonstrates high accuracy and robustness across segmentation and classification tasks on diverse datasets. Its adaptability to large-scale, non-dermoscopic data such as SLICE-3D confirms its potential for deployment in real-world skin cancer triage and teledermatology applications.</p><h2>Other Information</h2><p dir="ltr">Published in: DIGITAL HEALTH<br>License: <a href="https://creativecommons.org/licenses/by/4.0/deed.en" target="_blank">https://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1177/20552076251351858" target="_blank">https://dx.doi.org/10.1177/20552076251351858</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_160d24636a271c85d1cbbb356c7c744f |
| identifier_str_mv | 10.1177/20552076251351858 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/30541355 |
| publishDate | 2025 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | Dual-stage segmentation and classification framework for skin lesion analysis using deep neural networkKhadija Manzoor (22565369)Nauman U Gilal (22565372)Marco Agus (8032898)Jens Schneider (16885948)EngineeringBiomedical engineeringHealth sciencesHealth services and systemsInformation and computing sciencesArtificial intelligenceSkin lesion segmentationdeep learningimage augmentationskin disease classificationskin cancer<h3>Objective</h3><p dir="ltr">Skin diseases, caused by various pathogens including bacteria, viruses, and fungi, are prevalent globally and significantly affect patients’ physical, emotional, and social well-being. Early and accurate detection of such conditions is critical to prevent progression, especially in cases of malignant skin lesions. This study aims to develop a dual-stage deep learning framework for the segmentation and classification of skin lesions, addressing challenges such as imbalanced data, lesion variability, and low contrast.</p><h3>Methods</h3><p dir="ltr">We propose a two-phase framework: (i) Precise instance segmentation using U-Net with a Visual Geometry Group (VGG16 encoder) to isolate skin lesions and (ii) classification using EfficientFormer and SwiftFormer networks to evaluate performance on both balanced and imbalanced datasets. Experiments were conducted on three benchmark datasets: Human against machine with 10,000 training images (HAM10000), International Skin Imaging Collaboration (ISIC) 2018, and the newly released ISIC 2024 SLICE-3D dataset. For SLICE-3D, we evaluated both tabular-only and image + metadata fusion approaches using XGBoost classifier and ResNet-based classifier, respectively.</p><h3>Results</h3><p dir="ltr">On the balanced HAM10000 dataset, EfficientFormerV2 achieved 97.11% accuracy, a 97.14% F 1 -score, 96.85% sensitivity, and 96.70% specificity. On the ISIC 2018 dataset, the segmentation model achieved 97.59% accuracy, 89.12% Jaccard index, and 94.24% Dice similarity coefficient. For the ISIC 2024 SLICE-3D challenge, the tabular-only XGBoost classifier achieved a partial area under the receiver operating characteristic curve score of 0.16752, while the image + tabular fusion model achieved a score of 0.15792 using ResNet, demonstrating competitive performance in a highly imbalanced and clinically realistic setting.</p><h3>Conclusion</h3><p dir="ltr">The proposed dual-stage deep learning framework demonstrates high accuracy and robustness across segmentation and classification tasks on diverse datasets. Its adaptability to large-scale, non-dermoscopic data such as SLICE-3D confirms its potential for deployment in real-world skin cancer triage and teledermatology applications.</p><h2>Other Information</h2><p dir="ltr">Published in: DIGITAL HEALTH<br>License: <a href="https://creativecommons.org/licenses/by/4.0/deed.en" target="_blank">https://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1177/20552076251351858" target="_blank">https://dx.doi.org/10.1177/20552076251351858</a></p>2025-07-13T09:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1177/20552076251351858https://figshare.com/articles/journal_contribution/Dual-stage_segmentation_and_classification_framework_for_skin_lesion_analysis_using_deep_neural_network/30541355CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/305413552025-07-13T09:00:00Z |
| spellingShingle | Dual-stage segmentation and classification framework for skin lesion analysis using deep neural network Khadija Manzoor (22565369) Engineering Biomedical engineering Health sciences Health services and systems Information and computing sciences Artificial intelligence Skin lesion segmentation deep learning image augmentation skin disease classification skin cancer |
| status_str | publishedVersion |
| title | Dual-stage segmentation and classification framework for skin lesion analysis using deep neural network |
| title_full | Dual-stage segmentation and classification framework for skin lesion analysis using deep neural network |
| title_fullStr | Dual-stage segmentation and classification framework for skin lesion analysis using deep neural network |
| title_full_unstemmed | Dual-stage segmentation and classification framework for skin lesion analysis using deep neural network |
| title_short | Dual-stage segmentation and classification framework for skin lesion analysis using deep neural network |
| title_sort | Dual-stage segmentation and classification framework for skin lesion analysis using deep neural network |
| topic | Engineering Biomedical engineering Health sciences Health services and systems Information and computing sciences Artificial intelligence Skin lesion segmentation deep learning image augmentation skin disease classification skin cancer |