Attenuating Bias in Word Vectors

Citations Over Time

Abstract

Word vector representations are well developed tools for various NLP and Machine Learning tasks and are known to retain significant semantic and syntactic structure of languages. But they are prone to carrying and amplifying bias which can perpetrate discrimination in various applications. In this work, we explore new simple ways to detect the most stereotypically gendered words in an embedding and remove the bias from them. We verify how names are masked carriers of gender bias and then use that as a tool to attenuate bias in embeddings. Further, we extend this property of names to show how names can be used to detect other types of bias in the embeddings such as bias based on race, ethnicity, and age.

Related Papers

• → Embedding as a modeling problem(1998)167 cited
• → Four Ways of Thinking about Race(2019)2 cited
• → “Primitive race”, “pure race”, “brown race”, “every race”: Louis Freycinet’s Understanding of Human Difference in Oceania(2013)1 cited
• → Race Factor in the US Presidential Politics: Elevating the Dialogue(1993)
• → The Beginning of Chunpyeong(天坪) Culture at Mt. Baekdu(白頭) and the Formation of the Korean people(Han韓 race·Yemaek濊貊 race·Saepark새밝 race·Maek貊 race) in early Baedalkook(倍達國)(2020)