Deterministic Inference of Topic Models via Maximal Latent State Replication
Citations Over Time
Abstract
Probabilistic topic models, such as latent dirichlet allocation (LDA), are often used to discover hidden semantic structure of a collection of documents. In recent years, various inference algorithms have been developed to cope with learning of topic models, among which Gibbs sampling methods remain a popular choice. In this paper, we aim to improve the inference of topic models based on the Gibbs sampling framework. We extend a state augmentation based Gibbs sampling method by maximizing the replications of latent states, and propose a new generic deterministic inference method, named maximal latent state replication (MAX), for learning of a family of probabilistic topic models. One key benefit of the proposed method lies in the deterministic nature for inference, which may help to improve its running efficiency as well as predictive perplexity. We have conducted extensive experiments on real-life publicly available datasets, and the results have validated that our proposed method MAX significantly outperforms state-of-the-art baselines for inference of existing well-known topic models.
Related Papers
- → Applying Latent Dirichlet Allocation to Automatic Essay Grading(2006)39 cited
- → Analisis Topik Modelling Terhadap Penggunaan Sosial Media Twitter oleh Pejabat Negara(2021)14 cited
- → Performance evaluation of Latent Dirichlet Allocation in text mining(2011)28 cited
- Broadcast News Story Segmentation Using Manifold Learning on Latent Topic Distributions(2013)
- → Topic Modeling on WhatsApp User Reviews Using Latent Dirichlet Allocation(2022)2 cited