Semantic Coherence Facilitates Distributional Learning

Citations Over TimeTop 13% of 2016 papers

Abstract

Computational models have shown that purely statistical knowledge about words' linguistic contexts is sufficient to learn many properties of words, including syntactic and semantic category. For example, models can infer that "postman" and "mailman" are semantically similar because they have quantitatively similar patterns of association with other words (e.g., they both tend to occur with words like "deliver," "truck," "package"). In contrast to these computational results, artificial language learning experiments suggest that distributional statistics alone do not facilitate learning of linguistic categories. However, experiments in this paradigm expose participants to entirely novel words, whereas real language learners encounter input that contains some known words that are semantically organized. In three experiments, we show that (a) the presence of familiar semantic reference points facilitates distributional learning and (b) this effect crucially depends both on the presence of known words and the adherence of these known words to some semantic organization.

Related Papers

• → SyMSS: A syntax-based measure for short-text semantic similarity(2011)130 cited
• → Measuring Semantic Similarity Between Sentences Using A Siamese Neural Network(2018)23 cited
• → Distributional Semantics for CRM: Making Word2vec Models Robust by Structurizing Them(2020)1 cited
• → PESTS: Persian_English Cross Lingual Corpus for Semantic Textual Similarity(2023)
• → A hybrid method for cross lingual semantic textual similarity(2023)