End to End Binarized Neural Networks for Text Classification

Citations Over TimeTop 10% of 2020 papers

Abstract

Deep neural networks have demonstrated their superior performance in almost every Natural Language Processing task, however, their increasing complexity raises concerns. A particular concern is that these networks pose high requirements for computing hardware and training budgets. The state-of-the-art transformer models are a vivid example. Simplifying the computations performed by a network is one way of addressing the issue of the increasing complexity. In this paper, we propose an end to end binarized neural network for the task of intent and text classification. In order to fully utilize the potential of end to end binarization, both the input representations (vector embeddings of tokens statistics) and the classifier are binarized. We demonstrate the efficiency of such a network on the intent classification of short texts over three datasets and text classification with a larger dataset. On the considered datasets, the proposed network achieves comparable to the state-of-the-art results while utilizing 20-40% lesser memory and training time compared to the benchmarks.

Related Papers

• → Brain tumor segmentation and classification in MRI using SVM and its variants: a survey(2022)30 cited
• AUTOMATED CLASSIFICATION OF BRAIN MRI USING COLORCONVERTED K-MEANS CLUSTERING SEGMENTATION AND APPLICATION OF DIFFERENT KERNEL FUNCTIONS WITH MULTI-CLASS SVM(2013)
• → A comparison of feature selection methods for machine learning based automatic malarial cell recognition in wholeslide images(2016)19 cited
• → RETRACTED ARTICLE: Drug–target interaction prediction using artificial intelligence(2021)7 cited
• → Combined SVM and PCA to Recognize the Brain Function from fMRI Images(2009)3 cited