KL-Divergence Guided Temperature Sampling

Citations Over Time

Abstract

Temperature sampling is a conventional approach to diversify large language model predictions. As temperature increases, the prediction becomes diverse but also vulnerable to hallucinations -- generating tokens that are sensible but not factual. One common approach to mitigate hallucinations is to provide source/grounding documents and the model is trained to produce predictions that bind to and are attributable to the provided source. It appears that there is a trade-off between diversity and attribution. To mitigate any such trade-off, we propose to relax the constraint of having a fixed temperature over decoding steps, and a mechanism to guide the dynamic temperature according to its relevance to the source through KL-divergence. Our experiments justifies the trade-off, and shows that our sampling algorithm outperforms the conventional top-k and top-p algorithms in conversational question-answering and summarization tasks.

Related Papers

• → Anchoring Effects in Judging Grammaticality of Sentences(1992)84 cited
• → Acceptability prediction by means of grammaticality quantification(2006)15 cited
• → Judgments of Grammaticality as Related to Judgments of Meaningfulness and Ordinariness(1997)2 cited
• → The effect of grammaticality of sentences on grammaticality judgment performance and awareness of knowledge drawn on by learners of Korean as a second language(2018)