The Rwth Asr System for Ted-Lium Release 2: Improving Hybrid Hmm With Specaugment

Citations Over TimeTop 10% of 2020 papers

Abstract

We present a complete training pipeline to build a state-of-the-art hybrid HMM-based ASR system on the 2nd release of the TED-LIUM corpus. Data augmentation using SpecAugment is successfully applied to improve performance on top of our best SAT model using i-vectors. By investigating the effect of different maskings, we achieve improvements from SpecAugment on hybrid HMM models without increasing model size and training time. A subsequent sMBR training is applied to fine-tune the final acoustic model, and both LSTM and Transformer language models are trained and evaluated. Our best system achieves a 5.6% WER on the test set, which outperforms the previous state-of-the-art by 27% relative.

Related Papers

• → The Thirty-one Benchmark Steroids Revisited: Comparative Molecular Moment Analysis (CoMMA) with Principal Component Regression(2000)24 cited
• → Distributed acoustic modeling with back-off n-grams(2012)5 cited
• → The effect of data diversity on the performance of deep learning models for predicting early gastric cancer under endoscopy(2022)2 cited
• → Quantitative Structure-Activity Relationships in Carboquinones and Benzodiazepines Using Counter-Propagation Neural Networks(1995)24 cited
• → On the importance of pre-training data volume for compact language\n models(2020)