Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications
Citations Over TimeTop 1% of 2019 papers
Abstract
Obstacles hindering the development of capsule networks for challenging NLP applications include poor scalability to large output spaces and less reliable routing processes. In this paper, we introduce: (i) an agreement score to evaluate the performance of routing processes at instance-level; (ii) an adaptive optimizer to enhance the reliability of routing; (iii) capsule compression and partial routing to improve the scalability of capsule networks. We validate our approach on two NLP tasks, namely: multi-label text classification and question answering. Experimental results show that our approach considerably improves over strong competitors on both tasks. In addition, we gain the best results in low-resource settings with few training instances.
Related Papers
- → Scalability Issues of Blockchain Technology(2020)30 cited
- → INVITED PAPER: Scalability and Performance Issues in Deeply Embedded Sensor Systems(2009)7 cited
- → On the scalability of multistage interconnection networks(2004)3 cited
- → Using Empirical Data for Scalability Analysis of Parallel Applications(2019)1 cited
- RESEARCH ON THE SCALABILITY OF THE LARGE SCALE PARALLEL APPLICATION PROGRAMS(2000)