"I wouldn't say offensive but...": Disability-Centered Perspectives on Large Language Models

Citations Over TimeTop 1% of 2023 papers

Abstract

Large language models (LLMs) trained on real-world data can inadvertently reflect harmful societal biases, particularly toward historically marginalized communities. While previous work has primarily focused on harms related to age and race, emerging research has shown that biases toward disabled communities exist. This study extends prior work exploring the existence of harms by identifying categories of LLM-perpetuated harms toward the disability community. We conducted 19 focus groups, during which 56 participants with disabilities probed a dialog model about disability and discussed and annotated its responses. Participants rarely characterized model outputs as blatantly offensive or toxic. Instead, participants used nuanced language to detail how the dialog model mirrored subtle yet harmful stereotypes they encountered in their lives and dominant media, e.g., inspiration porn and able-bodied saviors. Participants often implicated training data as a cause for these stereotypes and recommended training the model on diverse identities from disability-positive resources. Our discussion further explores representative data strategies to mitigate harm related to different communities through annotation co-design with ML researchers and developers.

Related Papers

• → Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contexts(2021)49 cited
• The Soviet Strategic Offensive in Manchuria, 1945: 'August Storm'(2003)
• Susquehanna Chorale Spring Concert "Roots and Wings"(2017)
• → Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contexts(2021)
• Correlation of offensive and defensive operations(2002)