Evaluating the Impact of Human Explanation Strategies on Human-AI Visual Decision-Making

Citations Over TimeTop 10% of 2023 papers

Abstract

Artificial intelligence (AI) is increasingly being deployed in high-stakes domains, such as disaster relief and radiology, to aid practitioners during the decision-making process. Explainable AI techniques have been developed and deployed to provide users insights into why the AI made certain predictions. However, recent research suggests that these techniques may confuse or mislead users. We conducted a series of two studies to uncover strategies that humans use to explain decisions and then understand how those explanation strategies impact visual decision-making. In our first study, we elicit explanations from humans when assessing and localizing damaged buildings after natural disasters from satellite imagery and identify four core explanation strategies that humans employed. We then follow up by studying the impact of these explanation strategies by framing the explanations from Study 1 as if they were generated by AI and showing them to a different set of decision-makers performing the same task. We provide initial insights on how causal explanation strategies improve humans' accuracy and calibrate humans' reliance on AI when the AI is incorrect. However, we also find that causal explanation strategies may lead to incorrect rationalizations when AI presents a correct assessment with incorrect localization. We explore the implications of our findings for the design of human-centered explainable AI and address directions for future work.

Related Papers

• → Framing multiple others and international norms: the migrant worker advocacy movement and Korean national identity reconstruction(2009)28 cited
• → Framing the European Union and Building the Media Agenda: The 2004 European Parliamentary Elections in the Spanish Daily Press(2009)11 cited
• → Discursive strategies and activist framing in anti-mining campaigns(2023)3 cited
• Representing Recovery: Science and Local Control in the Framing of U.S. Pacific Northwest Salmon Policy(2008)
• → Framing War: Public Opinion and Decision-Making in Comparative Perspective(2014)6 cited