Adequacy–Fluency Metrics: Evaluating MT in the Continuous Space Model Framework

Citations Over TimeTop 10% of 2015 papers

Abstract

This work extends and evaluates a two-dimensional automatic evaluation metric for machine translation, which is designed to operate at the sentence level. The metric is based on the concepts of adequacy and fluency, aiming at decoupling both semantic and syntactic components of the translation process to provide a more balanced view on translation quality. These two elements are independently evaluated by using continuous space and $n$ -gram language modeling frameworks, respectively. Two different implementations are evaluated: a monolingual version that fully operates on the target language side, and a cross-language version that has the main advantage of not requiring reference translations. Both implementations are evaluated by comparing their performance with state-of-the-art automatic metrics over a dataset involving five different European languages.

Related Papers

• Pre-Translation for Neural Machine Translation.(2016)
• → Evaluation of English–Slovak Neural and Statistical Machine Translation(2021)21 cited
• → Impact of corpus size and quality on English-Bangla statistical Machine Translation system(2011)6 cited
• → Statistical Error Analysis of Machine Translation: The Case of Arabic(2020)3 cited
• → Automatic Evaluation of Machine Translation Based on Linguistic Knowledge(2023)