Large-scale visual sentiment ontology and detectors using adjective noun pairs
Citations Over TimeTop 1% of 2013 papers
Abstract
We address the challenge of sentiment analysis from visual content. In contrast to existing methods which infer sentiment or emotion directly from visual low-level features, we propose a novel approach based on understanding of the visual concepts that are strongly related to sentiments. Our key contribution is two-fold: first, we present a method built upon psychological theories and web mining to automatically construct a large-scale Visual Sentiment Ontology (VSO) consisting of more than 3,000 Adjective Noun Pairs (ANP). Second, we propose SentiBank, a novel visual concept detector library that can be used to detect the presence of 1,200 ANPs in an image. The VSO and SentiBank are distinct from existing work and will open a gate towards various applications enabled by automatic sentiment analysis. Experiments on detecting sentiment of image tweets demonstrate significant improvement in detection accuracy when comparing the proposed SentiBank based predictors with the text-based approaches. The effort also leads to a large publicly available resource consisting of a visual sentiment ontology, a large detector library, and the training/testing benchmark for visual sentiment analysis.
Related Papers
- Places of Adjectives as Modificators of Nouns(2003)
- On the Typology Feature of Nouns and Their Adjectives'Word Orders in Miao Language(2004)
- → Związki przymiotnika "były" z rzeczownikami(2019)
- Beowulf 에 나타난 복합어의 어순(1998)
- → SIDE NAMES WITH AUXILIARY VERBS IN UIGHUR TURKISH(2022)