How the different explanation classes impact trust calibration: The case of clinical decision support systems
<p>Machine learning has made rapid advances in safety-critical applications, such as traffic control, finance, and healthcare. With the criticality of decisions they support and the potential consequences of following their recommendations, it also became critical to provide users with explana...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | , , |
| منشور في: |
2022
|
| الموضوعات: | |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513507594076160 |
|---|---|
| author | Mohammad Naiseh (18513738) |
| author2 | Dena Al-Thani (16864245) Nan Jiang (21252) Raian Ali (12066006) |
| author2_role | author author author |
| author_facet | Mohammad Naiseh (18513738) Dena Al-Thani (16864245) Nan Jiang (21252) Raian Ali (12066006) |
| author_role | author |
| dc.creator.none.fl_str_mv | Mohammad Naiseh (18513738) Dena Al-Thani (16864245) Nan Jiang (21252) Raian Ali (12066006) |
| dc.date.none.fl_str_mv | 2022-10-15T21:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1016/j.ijhcs.2022.102941 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/How_the_different_explanation_classes_impact_trust_calibration_The_case_of_clinical_decision_support_systems/26796229 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Information and computing sciences Artificial intelligence Data management and data science Machine learning Explainable AI Clinical decision support systems Human-AI Interaction Trust Calibration |
| dc.title.none.fl_str_mv | How the different explanation classes impact trust calibration: The case of clinical decision support systems |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p>Machine learning has made rapid advances in safety-critical applications, such as traffic control, finance, and healthcare. With the criticality of decisions they support and the potential consequences of following their recommendations, it also became critical to provide users with explanations to interpret machine learning models in general, and black-box models in particular. However, despite the agreement on explainability as a necessity, there is little evidence on how recent advances in eXplainable Artificial Intelligence literature (XAI) can be applied in collaborative decision-making tasks, i.e., human decision-maker and an AI system working together, to contribute to the process of trust calibration effectively. This research conducts an empirical study to evaluate four XAI classes for their impact on trust calibration. We take clinical decision support systems as a case study and adopt a within-subject design followed by semi-structured interviews. We gave participants clinical scenarios and XAI interfaces as a basis for decision-making and rating tasks. Our study involved 41 medical practitioners who use clinical decision support systems frequently. We found that users perceive the contribution of explanations to trust calibration differently according to the XAI class and to whether XAI interface design fits their job constraints and scope. We revealed additional requirements on how explanations shall be instantiated and designed to help a better trust calibration. Finally, we build on our findings and present guidelines for designing XAI interfaces.</p><h2>Other Information</h2> <p> Published in: International Journal of Human-Computer Studies<br> License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.ijhcs.2022.102941" target="_blank">https://dx.doi.org/10.1016/j.ijhcs.2022.102941</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_f08a7067b990be048a1b504d2a2dcf28 |
| identifier_str_mv | 10.1016/j.ijhcs.2022.102941 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/26796229 |
| publishDate | 2022 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | How the different explanation classes impact trust calibration: The case of clinical decision support systemsMohammad Naiseh (18513738)Dena Al-Thani (16864245)Nan Jiang (21252)Raian Ali (12066006)Information and computing sciencesArtificial intelligenceData management and data scienceMachine learningExplainable AIClinical decision support systemsHuman-AI InteractionTrust Calibration<p>Machine learning has made rapid advances in safety-critical applications, such as traffic control, finance, and healthcare. With the criticality of decisions they support and the potential consequences of following their recommendations, it also became critical to provide users with explanations to interpret machine learning models in general, and black-box models in particular. However, despite the agreement on explainability as a necessity, there is little evidence on how recent advances in eXplainable Artificial Intelligence literature (XAI) can be applied in collaborative decision-making tasks, i.e., human decision-maker and an AI system working together, to contribute to the process of trust calibration effectively. This research conducts an empirical study to evaluate four XAI classes for their impact on trust calibration. We take clinical decision support systems as a case study and adopt a within-subject design followed by semi-structured interviews. We gave participants clinical scenarios and XAI interfaces as a basis for decision-making and rating tasks. Our study involved 41 medical practitioners who use clinical decision support systems frequently. We found that users perceive the contribution of explanations to trust calibration differently according to the XAI class and to whether XAI interface design fits their job constraints and scope. We revealed additional requirements on how explanations shall be instantiated and designed to help a better trust calibration. Finally, we build on our findings and present guidelines for designing XAI interfaces.</p><h2>Other Information</h2> <p> Published in: International Journal of Human-Computer Studies<br> License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.ijhcs.2022.102941" target="_blank">https://dx.doi.org/10.1016/j.ijhcs.2022.102941</a></p>2022-10-15T21:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1016/j.ijhcs.2022.102941https://figshare.com/articles/journal_contribution/How_the_different_explanation_classes_impact_trust_calibration_The_case_of_clinical_decision_support_systems/26796229CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/267962292022-10-15T21:00:00Z |
| spellingShingle | How the different explanation classes impact trust calibration: The case of clinical decision support systems Mohammad Naiseh (18513738) Information and computing sciences Artificial intelligence Data management and data science Machine learning Explainable AI Clinical decision support systems Human-AI Interaction Trust Calibration |
| status_str | publishedVersion |
| title | How the different explanation classes impact trust calibration: The case of clinical decision support systems |
| title_full | How the different explanation classes impact trust calibration: The case of clinical decision support systems |
| title_fullStr | How the different explanation classes impact trust calibration: The case of clinical decision support systems |
| title_full_unstemmed | How the different explanation classes impact trust calibration: The case of clinical decision support systems |
| title_short | How the different explanation classes impact trust calibration: The case of clinical decision support systems |
| title_sort | How the different explanation classes impact trust calibration: The case of clinical decision support systems |
| topic | Information and computing sciences Artificial intelligence Data management and data science Machine learning Explainable AI Clinical decision support systems Human-AI Interaction Trust Calibration |