Reinforcement learning-based dynamic pruning for distributed inference via explainable AI in healthcare IoT systems
<p>Deep Neural Networks (DNNs) have become the key technique to revolutionize the healthcare sector. However, conducting online remote inference is often impractical due to privacy constraints and latency requirements. To enable local computation, researchers have attempted network pruning wit...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | , , , |
| منشور في: |
2024
|
| الموضوعات: | |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513528318132224 |
|---|---|
| author | Emna Baccour (16896366) |
| author2 | Aiman Erbad (14150589) Amr Mohamed (3508121) Mounir Hamdi (14150652) Mohsen Guizani (12580291) |
| author2_role | author author author author |
| author_facet | Emna Baccour (16896366) Aiman Erbad (14150589) Amr Mohamed (3508121) Mounir Hamdi (14150652) Mohsen Guizani (12580291) |
| author_role | author |
| dc.creator.none.fl_str_mv | Emna Baccour (16896366) Aiman Erbad (14150589) Amr Mohamed (3508121) Mounir Hamdi (14150652) Mohsen Guizani (12580291) |
| dc.date.none.fl_str_mv | 2024-06-01T00:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1016/j.future.2024.01.021 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/Reinforcement_learning-based_dynamic_pruning_for_distributed_inference_via_explainable_AI_in_healthcare_IoT_systems/25151627 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Information and computing sciences Software engineering Healthcare Scarce data Resource constraints Distributed inference XAI Pruning |
| dc.title.none.fl_str_mv | Reinforcement learning-based dynamic pruning for distributed inference via explainable AI in healthcare IoT systems |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p>Deep Neural Networks (DNNs) have become the key technique to revolutionize the healthcare sector. However, conducting online remote inference is often impractical due to privacy constraints and latency requirements. To enable local computation, researchers have attempted network pruning with minimal accuracy loss or DNN distribution without affecting the performance. Yet, distributed inference can be inefficient due to the energy overhead and fluctuation of communication channels between participants. On the other hand, given that realistic healthcare systems use pre-trained models, local pruning and retraining relying only on the available scarce data is not possible. Even pre-pruned DNNs are limited in their ability to customize to the local load of data and device dynamics. The online pruning of DNN inferences without retraining is viable; however, it was not considered in the literature as most well-known techniques do not perform well without adjustment. In this paper, we propose a novel pruning strategy using Explainable AI (XAI) to enhance the performance of pruned DNNs without retraining, a necessity due to the scarcity and bias of local healthcare data. We combine distribution and pruning techniques to perform online distributed inference assisted by dynamic pruning when needed for highest accuracy. We use Non-Linear Integer Programming (NLP) to formulate our approach as a trade-off between resources and accuracy, and Reinforcement Learning (RL) to relax the problem and adapt to dynamic requirements. Our pruning criterion shows high performance compared to other reference techniques and ability to assist distribution by reducing resource usage while keeping high accuracy.</p><h2>Other Information</h2> <p> Published in: Future Generation Computer Systems<br> License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.future.2024.01.021" target="_blank">https://dx.doi.org/10.1016/j.future.2024.01.021</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_b4db2f0782ed1001dc26e26c7e6367ad |
| identifier_str_mv | 10.1016/j.future.2024.01.021 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/25151627 |
| publishDate | 2024 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | Reinforcement learning-based dynamic pruning for distributed inference via explainable AI in healthcare IoT systemsEmna Baccour (16896366)Aiman Erbad (14150589)Amr Mohamed (3508121)Mounir Hamdi (14150652)Mohsen Guizani (12580291)Information and computing sciencesSoftware engineeringHealthcareScarce dataResource constraintsDistributed inferenceXAIPruning<p>Deep Neural Networks (DNNs) have become the key technique to revolutionize the healthcare sector. However, conducting online remote inference is often impractical due to privacy constraints and latency requirements. To enable local computation, researchers have attempted network pruning with minimal accuracy loss or DNN distribution without affecting the performance. Yet, distributed inference can be inefficient due to the energy overhead and fluctuation of communication channels between participants. On the other hand, given that realistic healthcare systems use pre-trained models, local pruning and retraining relying only on the available scarce data is not possible. Even pre-pruned DNNs are limited in their ability to customize to the local load of data and device dynamics. The online pruning of DNN inferences without retraining is viable; however, it was not considered in the literature as most well-known techniques do not perform well without adjustment. In this paper, we propose a novel pruning strategy using Explainable AI (XAI) to enhance the performance of pruned DNNs without retraining, a necessity due to the scarcity and bias of local healthcare data. We combine distribution and pruning techniques to perform online distributed inference assisted by dynamic pruning when needed for highest accuracy. We use Non-Linear Integer Programming (NLP) to formulate our approach as a trade-off between resources and accuracy, and Reinforcement Learning (RL) to relax the problem and adapt to dynamic requirements. Our pruning criterion shows high performance compared to other reference techniques and ability to assist distribution by reducing resource usage while keeping high accuracy.</p><h2>Other Information</h2> <p> Published in: Future Generation Computer Systems<br> License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.future.2024.01.021" target="_blank">https://dx.doi.org/10.1016/j.future.2024.01.021</a></p>2024-06-01T00:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1016/j.future.2024.01.021https://figshare.com/articles/journal_contribution/Reinforcement_learning-based_dynamic_pruning_for_distributed_inference_via_explainable_AI_in_healthcare_IoT_systems/25151627CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/251516272024-06-01T00:00:00Z |
| spellingShingle | Reinforcement learning-based dynamic pruning for distributed inference via explainable AI in healthcare IoT systems Emna Baccour (16896366) Information and computing sciences Software engineering Healthcare Scarce data Resource constraints Distributed inference XAI Pruning |
| status_str | publishedVersion |
| title | Reinforcement learning-based dynamic pruning for distributed inference via explainable AI in healthcare IoT systems |
| title_full | Reinforcement learning-based dynamic pruning for distributed inference via explainable AI in healthcare IoT systems |
| title_fullStr | Reinforcement learning-based dynamic pruning for distributed inference via explainable AI in healthcare IoT systems |
| title_full_unstemmed | Reinforcement learning-based dynamic pruning for distributed inference via explainable AI in healthcare IoT systems |
| title_short | Reinforcement learning-based dynamic pruning for distributed inference via explainable AI in healthcare IoT systems |
| title_sort | Reinforcement learning-based dynamic pruning for distributed inference via explainable AI in healthcare IoT systems |
| topic | Information and computing sciences Software engineering Healthcare Scarce data Resource constraints Distributed inference XAI Pruning |