Simple task-specific bilingual word embeddings

Citations Over TimeTop 1% of 2015 papers

Abstract

We introduce a simple wrapper method that uses off-the-shelf word embedding algorithms to learn task-specific bilingual word embeddings. We use a small dictionary of easily-obtainable task-specific word equivalence classes to produce mixed context-target pairs that we use to train off-the-shelf embedding models. Our model has the advantage that it (a) is independent of the choice of embedding algorithm, (b) does not require parallel data, and (c) can be adapted to specific tasks by re-defining the equivalence classes. We show how our method outperforms off-the-shelf bilingual embeddings on the task of unsupervised cross-language partof-speech (POS) tagging, as well as on the task of semi-supervised cross-language super sense (SuS) tagging.

Related Papers

• → How to Generate a Good Word Embedding(2016)316 cited
• → Unsupervised Learning: Word Vector(2021)1 cited
• → NMT Multi-Sense Embeddings per Word(2019)
• → Multi-Sense Embeddings per Word(2020)
• → Dual embedding with input embedding and output embedding for better word representation(2022)