Denoising Pre-Training and Data Augmentation Strategies for Enhanced RDF Verbalization with Transformers
arXiv (Cornell University)2020
Citations Over Time
Abstract
The task of verbalization of RDF triples has known a growth in popularity due to the rising ubiquity of Knowledge Bases (KBs). The formalism of RDF triples is a simple and efficient way to store facts at a large scale. However, its abstract representation makes it difficult for humans to interpret. For this purpose, the WebNLG challenge aims at promoting automated RDF-to-text generation. We propose to leverage pre-trainings from augmented data with the Transformer model using a data augmentation strategy. Our experiment results show a minimum relative increases of 3.73%, 126.05% and 88.16% in BLEU score for seen categories, unseen entities and unseen categories respectively over the standard training.
Related Papers
- → Query-Independent Learning to Rank for RDF Entity Search(2012)27 cited
- → TermPicker: Enabling the Reuse of Vocabulary Terms by Exploiting Data from the Linked Open Data Cloud(2016)22 cited
- → TermPicker: Enabling the Reuse of Vocabulary Terms by Exploiting Data from the Linked Open Data Cloud - An Extended Technical Report(2015)4 cited
- Improving the Utility of Knowledge Graph Embeddings with Calibration.(2020)
- → Knowledge Base Completion Meets Transfer Learning(2021)