Word Embedding Calculus in Meaningful Ultradense Subspaces
2016pp. 512–517
Citations Over TimeTop 10% of 2016 papers
Abstract
We decompose a standard embedding space into interpretable orthogonal subspaces and a "remainder" subspace. We consider four interpretable subspaces in this paper: polarity, concreteness, frequency and part-of-speech (POS) subspaces. We introduce a new calculus for subspaces that supports operations like "-1 hate = love" and "give me a neutral word for greasy" (i.e., oleaginous). This calculus extends analogy computations like "king-man+woman = queen". For the tasks of Antonym Classification and POS Tagging our method outperforms the state of the art. We create test sets for Morphological Analogies and for the new task of Polarity Spectrum Creation.
Related Papers
- → Evasive subspaces(2021)14 cited
- → On badly approximable subspaces(2020)1 cited
- Technique for Determining Base of the Intersection of Subspaces in P~n(2005)
- 2-Maximal Subspaces of Vector Spaces(2012)
- → On the complemented subspaces of X_p(1990)