Quantifying Memorization Across Neural Language Models
Citations Over Time
Abstract
Large language models (LMs) have been shown to memorize parts of their training data, and when prompted appropriately, they will emit the memorized training data verbatim. This is undesirable because memorization violates privacy (exposing user data), degrades utility (repeated easy-to-memorize text is often low quality), and hurts fairness (some texts are memorized over others). We describe three log-linear relationships that quantify the degree to which LMs emit memorized training data. Memorization significantly grows as we increase (1) the capacity of a model, (2) the number of times an example has been duplicated, and (3) the number of tokens of context used to prompt the model. Surprisingly, we find the situation becomes more complicated when generalizing these results across model families. On the whole, we find that memorization in LMs is more prevalent than previously believed and will likely get worse as models continues to scale, at least without active mitigations.
Related Papers
- → Verification of Effectiveness of Memorizing Directions Using Virtual Reality(2020)1 cited
- → A study on memorization advancement method of work sequence(2000)1 cited
- → Exploring Memorization in Fine-tuned Language Models(2023)2 cited
- On the Dynamics of Memory Abilities with the Increased Difficulty of the Memory Task(2014)
- Application of Gamification of Qur'an Recitation and Hadith Based Android Using the Scott Method(2019)