Multiway Attention Networks for Modeling Sentence Pairs
Citations Over TimeTop 10% of 2018 papers
Abstract
Modeling sentence pairs plays the vital role for judging the relationship between two sentences, such as paraphrase identification, natural language inference, and answer sentence selection. Previous work achieves very promising results using neural networks with attention mechanism. In this paper, we propose the multiway attention networks which employ multiple attention functions to match sentence pairs under the matching-aggregation framework. Specifically, we design four attention functions to match words in corresponding sentences. Then, we aggregate the matching information from each function, and combine the information from all functions to obtain the final representation. Experimental results demonstrate that the proposed multiway attention networks improve the result on the Quora Question Pairs, SNLI, MultiNLI, and answer sentence selection task on the SQuAD dataset.
Related Papers
- Enlarging Paraphrase Collections through Generalization and Instantiation(2012)
- Finnish Paraphrase Corpus(2021)
- → Chinese Paraphrase Dataset and Detection(2021)2 cited
- Paraphrase extraction from interactive Q&A communities(2012)
- → A Study on the Application of Paraphrase Strategy in the Translation from Chinese to English(2018)1 cited