Counterfactual Data Augmentation improves Factuality of Abstractive Summarization
Citations Over Time
Abstract
Abstractive summarization systems based on pretrained language models often generate coherent but factually inconsistent sentences. In this paper, we present a counterfactual data augmentation approach where we augment data with perturbed summaries that increase the training data diversity. Specifically, we present three augmentation approaches based on replacing (i) entities from other and the same category and (ii) nouns with their corresponding WordNet hypernyms. We show that augmenting the training data with our approach improves the factual correctness of summaries without significantly affecting the ROUGE score. We show that in two commonly used summarization datasets (CNN/Dailymail and XSum), we improve the factual correctness by about 2.5 points on average
Related Papers
- → On the counterfactual nature of envy: “It could have been me”(2014)61 cited
- → Ai-based counterfactual reasoning for tourism research(2023)6 cited
- On the Applications of the Experience Summarization in Modern Teaching and Research(2000)
- → Counterfactual Instances Explain Little(2021)