Zero-shot Word Sense Disambiguation using Sense Definition Embeddings

Citations Over TimeTop 10% of 2019 papers

Abstract

Word Sense Disambiguation (WSD) is a longstanding but open problem in Natural Language Processing (NLP). WSD corpora are typically small in size, owing to an expensive annotation process. Current supervised WSD methods treat senses as discrete labels and also resort to predicting the Most-Frequent-Sense (MFS) for words unseen during training. This leads to poor performance on rare and unseen senses. To overcome this challenge, we propose Extended WSD Incorporating Sense Embeddings (EWISE), a supervised model to perform WSD by predicting over a continuous sense embedding space as opposed to a discrete label space. This allows EWISE to generalize over both seen and unseen senses, thus achieving generalized zeroshot learning. To obtain target sense embeddings, EWISE utilizes sense definitions. EWISE learns a novel sentence encoder for sense definitions by using WordNet relations and also ConvE, a recently proposed knowledge graph embedding method. We also compare EWISE against other sentence encoders pretrained on large corpora to generate definition embeddings. EWISE achieves new stateof-the-art WSD performance.

Related Papers

• → SenseLearner(2005)65 cited
• SenseLearner: Minimally Supervised Word Sense Disambiguation for All Words in Open Text(2004)
• → Using WordNet-Based Word Sense Disambiguation to Improve MT Performance(2016)5 cited
• Combining Methods for Word Sense Disambiguation of WordNet Glosses.(2004)
• The University of Alicante systems at Senseval-3(2004)