Hypothesis ranking and two-pass approaches for machine translation system combination
Citations Over TimeTop 11% of 2010 papers
Abstract
Given a number of machine translations of a source segment, the goal of system combination is to produce a new translation that has better quality than all of them. This paper describes a number of improvements that were recently added to the JHU system combination scheme: (i) A hypothesis ranking technique which orders the system outputs, on a per-segment basis, according to predicted translation quality, thus improving a subsequent incremental combination step. (ii) A two-pass combination procedure, which first produces several combination outputs with the given translations, and then performs one more combination step with these new outputs. Results from the NIST MT09 informal system combination evaluation on Arabic-to-English and Urdu-to-English 1 show that both approaches offer significant BLEU and TER gains over a baseline JHU combination scheme.
Related Papers
- → Interpreting BLEU/NIST Scores: How Much Improvement Do We Need to Have a Better System?(2004)165 cited
- → Neural Machine Translation of Indian Languages(2017)44 cited
- Better Evaluation Metrics Lead to Better Machine Translation(2011)
- Statistical Machine Translation with Rule based Machine Translation.(2011)
- → Technique for assessing PNA measurement repeatability using a NIST standard(2005)1 cited