Towards End-to-End In-Image Neural Machine Translation
2020pp. 70–74
Citations Over Time
Abstract
In this paper, we offer a preliminary investigation into the task of in-image machine translation: transforming an image containing text in one language into an image containing the same text in another language. We propose an end-to-end neural model for this task inspired by recent approaches to neural machine translation, and demonstrate promising initial results based purely on pixel-level supervision. We then offer a quantitative and qualitative evaluation of our system outputs and discuss some common failure modes. Finally, we conclude with directions for future work.
Related Papers
- → Multi-Task Learning for Multiple Language Translation(2015)612 cited
- → Interactive neural machine translation(2016)107 cited
- → Unraveling the Contribution of Image Captioning and Neural Machine Translation for Multimodal Machine Translation(2017)7 cited
- → English Translation Model Design Based on Neural Network(2019)3 cited