What Does it Mean for a Language Model to Preserve Privacy?

Citations Over TimeTop 1% of 2022 papers

Abstract

Natural language reflects our private lives and identities, making its privacy concerns as broad as those of real life. Language models lack the ability to understand the context and sensitivity of text, and tend to memorize phrases present in their training sets. An adversary can exploit this tendency to extract training data. Depending on the nature of the content and the context in which this data was collected, this could violate expectations of privacy. Thus, there is a growing interest in techniques for training language models that preserve privacy. In this paper, we discuss the mismatch between the narrow assumptions made by popular data protection techniques (data sanitization and differential privacy), and the broadness of natural language and of privacy as a social norm. We argue that existing protection methods cannot guarantee a generic and meaningful notion of privacy for language models. We conclude that language models should be trained on text data which was explicitly produced for public use.

Related Papers

• → A Federated Learning Scheme Based on Lightweight Differential Privacy(2023)7 cited
• → Development of an approach to automatic language identification based on phone recognition(1996)24 cited
• The model for identification of a natural language of the text(2011)
• → Toward new language adaptation for language identification(1997)4 cited
• Robust Techniques Of Language Modeling For Spoken Language Identification(2009)