Expoiting Syntactic Structure for Language Modeling
arXiv (Cornell University)1998
Citations Over Time
Abstract
The paper presents a language model that develops syntactic structure and uses it to extract meaningful information from the word history, thus enabling the use of long distance dependencies. The model assigns probability to every joint sequence of words--binary-parse-structure with headword annotation and operates in a left-to-right manner --- therefore usable for automatic speech recognition. The model, its probabilistic parameterization, and a set of experiments meant to evaluate its predictive power are presented; an improvement over standard trigram modeling is achieved.
Related Papers
- → A dynamic language model for speech recognition(1991)126 cited
- → Class phrase models for language modeling(2002)45 cited
- → Decoupling Word-Pair Distance and Co-occurrence Information for Effective Long History Context Language Modeling(2015)2 cited
- → Improving language models by using distant information(2007)3 cited
- → Syntactic Category Prediction for Improving Parsing Accuracy in English-Korean Machine Translation(2006)