Predicting semantically linkable knowledge in developer online forums via convolutional neural network

Citations Over TimeTop 1% of 2016 papers

Abstract

Consider a question and its answers in Stack Overflow as a knowledge unit. Knowledge units often contain semantically relevant knowledge, and thus linkable for different purposes, such as duplicate questions, directly linkable for problem solving, indirectly linkable for related information. Recognizing different classes of linkable knowledge would support more targeted information needs when users search or explore the knowledge base. Existing methods focus on binary relatedness (i.e., related or not), and are not robust to recognize different classes of semantic relatedness when linkable knowledge units share few words in common (i.e., have lexical gap). In this paper, we formulate the problem of predicting semantically linkable knowledge units as a multiclass classification problem, and solve the problem using deep learning techniques. To overcome the lexical gap issue, we adopt neural language model (word embeddings) and convolutional neural network (CNN) to capture word- and document-level semantics of knowledge units. Instead of using human-engineered classifier features which are hard to design for informal user-generated content, we exploit large amounts of different types of user-created knowledge-unit links to train the CNN to learn the most informative word- and sentence-level features for the multiclass classification task. Our evaluation shows that our deep-learning based approach significantly and consistently outperforms traditional methods using traditional word representations and human-engineered classifier features.

Related Papers

• → Overview of deep learning in medical imaging(2017)1,052 cited
• → Deep learning ensemble 2D CNN approach towards the detection of lung cancer(2023)173 cited
• → Research and Application of Ancient Chinese Pattern Restoration Based on Deep Convolutional Neural Network(2021)4 cited
• → Leaf Features Extraction for Plant Classification using CNN(2021)7 cited
• → Deep Convolution Neural Network for RBC Images(2022)2 cited