Taxonomy of Risks posed by Language Models
Citations Over TimeTop 1% of 2022 papers
Abstract
Responsible innovation on large-scale Language Models (LMs) requires foresight into and in-depth understanding of the risks these models may pose. This paper develops a comprehensive taxonomy of ethical and social risks associated with LMs. We identify twenty-one risks, drawing on expertise and literature from computer science, linguistics, and the social sciences. We situate these risks in our taxonomy of six risk areas: I. Discrimination, Hate speech and Exclusion, II. Information Hazards, III. Misinformation Harms, IV. Malicious Uses, V. Human-Computer Interaction Harms, and VI. Environmental and Socioeconomic harms. For risks that have already been observed in LMs, the causal mechanism leading to harm, evidence of the risk, and approaches to risk mitigation are discussed. We further describe and analyse risks that have not yet been observed but are anticipated based on assessments of other language technologies, and situate these in the same taxonomy. We underscore that it is the responsibility of organizations to engage with the mitigations we discuss throughout the paper. We close by highlighting challenges and directions for further research on risk evaluation and mitigation with the goal of ensuring that language models are developed responsibly.
Related Papers
- → Thinking clearly about misinformation(2024)18 cited
- → The battleground of COVID-19 vaccine misinformation on Facebook: Fact checkers vs. misinformation spreaders(2021)39 cited
- → The nature of misinformation in education(2023)16 cited
- → Twitter Analysis of Covid-19 Misinformation in Spain(2021)5 cited
- → Classification and Analysis of General Misinformation and Covid-related Misinformation within Subreddits of Opposing Political Viewpoints(2022)