The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer
IntroductionHER-2/neu is a protein present on the surface of specific cancer cells and has been linked to the development and progression of certain cancer types. It is present in 15 to 20% of breast cancers and is clinically significant due to the availability of multiple anti-Her2 treatment option...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | , , , , , , |
| التنسيق: | article |
| منشور في: |
2023
|
| الموضوعات: | |
| الوصول للمادة أونلاين: | http://dx.doi.org/10.1016/j.eswa.2023.122051 https://www.sciencedirect.com/science/article/pii/S0957417423025538 http://hdl.handle.net/10576/53087 |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1857415086572830720 |
|---|---|
| author | Saidul, Kabir |
| author2 | Vranic, Semir Mahmood Al Saady, Rafif Salman Khan, Muhammad Sarmun, Rusab Alqahtani, Abdulrahman Abbas, Tariq O. Chowdhury, Muhammad E.H. |
| author2_role | author author author author author author author |
| author_facet | Saidul, Kabir Vranic, Semir Mahmood Al Saady, Rafif Salman Khan, Muhammad Sarmun, Rusab Alqahtani, Abdulrahman Abbas, Tariq O. Chowdhury, Muhammad E.H. |
| author_role | author |
| dc.creator.none.fl_str_mv | Saidul, Kabir Vranic, Semir Mahmood Al Saady, Rafif Salman Khan, Muhammad Sarmun, Rusab Alqahtani, Abdulrahman Abbas, Tariq O. Chowdhury, Muhammad E.H. |
| dc.date.none.fl_str_mv | 2023-10-07 2024-03-14T10:47:42Z |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | http://dx.doi.org/10.1016/j.eswa.2023.122051 Kabir, S., Vranic, S., Al Saady, R. M., Khan, M. S., Sarmun, R., Alqahtani, A., ... & Chowdhury, M. E. (2024). The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer. Expert Systems with Applications, 238, 122051. 0957-4174 https://www.sciencedirect.com/science/article/pii/S0957417423025538 http://hdl.handle.net/10576/53087 238 1873-6793 |
| dc.language.none.fl_str_mv | en |
| dc.publisher.none.fl_str_mv | Elsevier |
| dc.rights.none.fl_str_mv | http://creativecommons.org/licenses/by/4.0/ info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Her-2/neu Breast cancer Immunohistochemistry (IHC) Hematoxylin-eosin (H&E) Artificial intelligence Deep learning Classification |
| dc.title.none.fl_str_mv | The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer |
| dc.type.none.fl_str_mv | Article info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/article |
| description | IntroductionHER-2/neu is a protein present on the surface of specific cancer cells and has been linked to the development and progression of certain cancer types. It is present in 15 to 20% of breast cancers and is clinically significant due to the availability of multiple anti-Her2 treatment options. Immunohistochemistry (IHC) is the most commonly used method to evaluate and quantify the expression of Her-2/neu. Although IHC is well-standardized in clinical practice, it is still subjected to inter-observer variability. Automating Her-2/neu scoring can improve accuracy, efficiency, consistency, and cost-effectiveness while reducing pathologists' workload. Materials and MethodsA deep learning-based automatic framework was utilized for the automatic detection of Her-2/neu score from whole slide images (WSI). The framework consists of three phases: identification of tumor patches, scoring of tumor patches, and Her-2/neu score prediction for whole slide images (WSI) based on the distribution of each score. This work used the dataset from the University of Warwick HER2 challenge contest. Two expert pathologists evaluated all 86 WSIs and assigned Her-2/neu scores to them. In addition, patches were generated from 50 WSIs and annotated individually by the pathologists. A total of 6641 extracted patches were generated out of which, 947 were labeled as 0, 327 as 1+, 1401 as 2+, 2950 as 3+, and 1016 were marked for discarding. Four pre-trained image classification models, namely DenseNet201, GoogleNet, MobileNet_v2, and a Vision Transformer based model, were fine-tuned, and tested on the generated patches. In order to predict the Her-2/neu score of the entire WSI, a random forest classifier was trained to predict the Her-2/neu score from the percentages of patches of each score present in the whole slide image. ResultsIn patch classification performances, the vision transformer-based model outperformed the other models by achieving an accuracy of 92.6% on tumor patch classification and 91.15% on patch score classification. The random forest classifier achieved an accuracy of 88% on four score classification (0, 1+, 2 + and 3 + ) and 96% on three score classification (0/1+, 2 + and 3 + ). ConclusionThe proposed deep learning-based framework for the automatic detection and evaluation of Her-2/neu expression in breast cancer obtained encouraging results. This framework has the potential to be used as a prognostic tool, providing a cost-effective and time-efficient alternative for generating clinically relevant results. However, additional research is required to assess the applicability of this pipeline in different contexts. |
| eu_rights_str_mv | openAccess |
| format | article |
| id | qu_e0240cb3fb10a4f3d3d5b8914b0df940 |
| identifier_str_mv | Kabir, S., Vranic, S., Al Saady, R. M., Khan, M. S., Sarmun, R., Alqahtani, A., ... & Chowdhury, M. E. (2024). The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer. Expert Systems with Applications, 238, 122051. 0957-4174 238 1873-6793 |
| language_invalid_str_mv | en |
| network_acronym_str | qu |
| network_name_str | Qatar University repository |
| oai_identifier_str | oai:qspace.qu.edu.qa:10576/53087 |
| publishDate | 2023 |
| publisher.none.fl_str_mv | Elsevier |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | http://creativecommons.org/licenses/by/4.0/ |
| spelling | The utility of a deep learning-based approach in Her-2/neu assessment in breast cancerSaidul, KabirVranic, SemirMahmood Al Saady, RafifSalman Khan, MuhammadSarmun, RusabAlqahtani, AbdulrahmanAbbas, Tariq O.Chowdhury, Muhammad E.H.Her-2/neuBreast cancerImmunohistochemistry (IHC)Hematoxylin-eosin (H&E)Artificial intelligenceDeep learningClassificationIntroductionHER-2/neu is a protein present on the surface of specific cancer cells and has been linked to the development and progression of certain cancer types. It is present in 15 to 20% of breast cancers and is clinically significant due to the availability of multiple anti-Her2 treatment options. Immunohistochemistry (IHC) is the most commonly used method to evaluate and quantify the expression of Her-2/neu. Although IHC is well-standardized in clinical practice, it is still subjected to inter-observer variability. Automating Her-2/neu scoring can improve accuracy, efficiency, consistency, and cost-effectiveness while reducing pathologists' workload. Materials and MethodsA deep learning-based automatic framework was utilized for the automatic detection of Her-2/neu score from whole slide images (WSI). The framework consists of three phases: identification of tumor patches, scoring of tumor patches, and Her-2/neu score prediction for whole slide images (WSI) based on the distribution of each score. This work used the dataset from the University of Warwick HER2 challenge contest. Two expert pathologists evaluated all 86 WSIs and assigned Her-2/neu scores to them. In addition, patches were generated from 50 WSIs and annotated individually by the pathologists. A total of 6641 extracted patches were generated out of which, 947 were labeled as 0, 327 as 1+, 1401 as 2+, 2950 as 3+, and 1016 were marked for discarding. Four pre-trained image classification models, namely DenseNet201, GoogleNet, MobileNet_v2, and a Vision Transformer based model, were fine-tuned, and tested on the generated patches. In order to predict the Her-2/neu score of the entire WSI, a random forest classifier was trained to predict the Her-2/neu score from the percentages of patches of each score present in the whole slide image. ResultsIn patch classification performances, the vision transformer-based model outperformed the other models by achieving an accuracy of 92.6% on tumor patch classification and 91.15% on patch score classification. The random forest classifier achieved an accuracy of 88% on four score classification (0, 1+, 2 + and 3 + ) and 96% on three score classification (0/1+, 2 + and 3 + ). ConclusionThe proposed deep learning-based framework for the automatic detection and evaluation of Her-2/neu expression in breast cancer obtained encouraging results. This framework has the potential to be used as a prognostic tool, providing a cost-effective and time-efficient alternative for generating clinically relevant results. However, additional research is required to assess the applicability of this pipeline in different contexts.This work was made possible by student grant # QUST-1-CENG-2023–941 from the Qatar University and is also supported via funding from Prince Sattam Bin Abdulaziz University project number (PSAU/2023/R/1444). The open access publication cost is covered by Qatar National Library.Elsevier2024-03-14T10:47:42Z2023-10-07Articleinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://dx.doi.org/10.1016/j.eswa.2023.122051Kabir, S., Vranic, S., Al Saady, R. M., Khan, M. S., Sarmun, R., Alqahtani, A., ... & Chowdhury, M. E. (2024). The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer. Expert Systems with Applications, 238, 122051.0957-4174https://www.sciencedirect.com/science/article/pii/S0957417423025538http://hdl.handle.net/10576/530872381873-6793enhttp://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:qspace.qu.edu.qa:10576/530872024-07-23T10:58:39Z |
| spellingShingle | The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer Saidul, Kabir Her-2/neu Breast cancer Immunohistochemistry (IHC) Hematoxylin-eosin (H&E) Artificial intelligence Deep learning Classification |
| status_str | publishedVersion |
| title | The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer |
| title_full | The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer |
| title_fullStr | The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer |
| title_full_unstemmed | The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer |
| title_short | The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer |
| title_sort | The utility of a deep learning-based approach in Her-2/neu assessment in breast cancer |
| topic | Her-2/neu Breast cancer Immunohistochemistry (IHC) Hematoxylin-eosin (H&E) Artificial intelligence Deep learning Classification |
| url | http://dx.doi.org/10.1016/j.eswa.2023.122051 https://www.sciencedirect.com/science/article/pii/S0957417423025538 http://hdl.handle.net/10576/53087 |