Evaluation of English–Slovak Neural and Statistical Machine Translation

Citations Over TimeTop 10% of 2021 papers

Abstract

This study is focused on the comparison of phrase-based statistical machine translation (SMT) systems and neural machine translation (NMT) systems using automatic metrics for translation quality evaluation for the language pair of English and Slovak. As the statistical approach is the predecessor of neural machine translation, it was assumed that the neural network approach would generate results with a better quality. An experiment was performed using residuals to compare the scores of automatic metrics of the accuracy (BLEU_n) of the statistical machine translation with those of the neural machine translation. The results showed that the assumption of better neural machine translation quality regardless of the system used was confirmed. There were statistically significant differences between the SMT and NMT in favor of the NMT based on all BLEU_n scores. The neural machine translation achieved a better quality of translation of journalistic texts from English into Slovak, regardless of if it was a system trained on general texts, such as Google Translate, or specific ones, such as the European Commission’s (EC’s) tool, which was trained on a specific-domain.

Related Papers

• → Design and Testing of Automatic Machine Translation System Based on Chinese-English Phrase Translation(2021)7 cited
• → Productivity and quality when editing machine translation and translation memory outputs: an empirical analysis of English to Welsh translation(2017)15 cited
• A Hybrid Approach to Example based Machine Translation for Indian Languages(2007)
• → Automatic Post-Editing Method Using Translation Knowledge Based on Intuitive Common Parts Continuum for Statistical Machine Translation(2014)
• Основные факторы улучшения машинного перевода(2015)