Analyzing Semantic Segmentation Using Hybrid Human-Machine CRFs
Citations Over TimeTop 10% of 2013 papers
Abstract
Recent trends in semantic image segmentation have pushed for holistic scene understanding models that jointly reason about various tasks such as object detection, scene recognition, shape analysis, contextual reasoning. In this work, we are interested in understanding the roles of these different tasks in aiding semantic segmentation. Towards this goal, we "plug-in" human subjects for each of the various components in a state-of-the-art conditional random field model (CRF) on the MSRC dataset. Comparisons among various hybrid human-machine CRFs give us indications of how much "head room" there is to improve segmentation by focusing research efforts on each of the tasks. One of the interesting findings from our slew of studies was that human classification of isolated super-pixels, while being worse than current machine classifiers, provides a significant boost in performance when plugged into the CRF! Fascinated by this finding, we conducted in depth analysis of the human generated potentials. This inspired a new machine potential which significantly improves state-of-the-art performance on the MRSC dataset.
Related Papers
- Chinese Named Entity Recognition with Conditional Random Fields(2006)
- → Result identification for biomedical abstracts using Conditional Random Fields(2008)6 cited
- → A Recognition Approach Study on Chinese Field Term Based Mutual Information /Conditional Random Fields(2012)3 cited
- Named entity recognition in Chinese medical records based on cascaded conditional random field(2014)
- → Biomedical Named Entity Recognition Using Second-Order Conditional Random Fields(2011)