Data Augmentation of Incorporating Real Error Patterns and Linguistic Knowledge for Grammatical Error Correction
Citations Over Time
Abstract
Data augmentation aims at expanding training data with clean text using noising schemes to improve the performance of grammatical error correction (GEC). In practice, there are a great number of real error patterns in the manually annotated training data. We argue that these real error patterns can be introduced into clean text to effectively generate more real and high quality synthetic data, which is not fully explored by previous studies. Moreover, we also find that linguistic knowledge can be incorporated into data augmentation for generating more representative and more diverse synthetic data. In this paper, we propose a novel data augmentation method that fully considers the real error patterns and the linguistic knowledge for the GEC task. We conduct extensive experiments on public data sets and the experimental results show that our method outperforms several strong baselines with far less external unlabeled clean text data, highlighting its extraordinary effectiveness in the GEC task that lacks large-scale labeled training data.
Related Papers
- → Emoticon Smoothed Language Models for Twitter Sentiment Analysis(2021)257 cited
- Constrained Grammatical Error Correction using Statistical Machine Translation(2013)
- → Evaluating prose style transfer with the Bible(2018)40 cited
- → How do you correct run-on sentences it’s not as easy as it seems(2018)4 cited
- → Noise Improves Noise: Verification of Pre-Training Effect with Weakly Labeled Data on Social Media NER(2020)3 cited