Pentagon at MEDIQA 2019: Multi-task Learning for Filtering and Re-ranking Answers using Language Inference and Question Entailment

Citations Over Time

Abstract

Parallel deep learning architectures like fine-tuned BERT and MT-DNN, have quickly become the state of the art, bypassing previous deep and shallow learning methods by a large margin. More recently, pre-trained models from large related datasets have been able to perform well on many downstream tasks by just fine-tuning on domain-specific datasets . However, using powerful models on non-trivial tasks, such as ranking and large document classification, still remains a challenge due to input size limitations of parallel architecture and extremely small datasets (insufficient for fine-tuning). In this work, we introduce an end-to-end system, trained in a multi-task setting, to filter and re-rank answers in the medical domain. We use task-specific pre-trained models as deep feature extractors. Our model achieves the highest Spearman's Rho and Mean Reciprocal Rank of 0.338 and 0.9622 respectively, on the ACL-BioNLP workshop MediQA Question Answering shared-task.

Related Papers

• COFI RANK - Maximum margin matrix factorization for collaborative ranking(2015)
• The MiPACQ clinical question answering system.(2011)
• → A Stacked BiLSTM Neural Network Based on Coattention Mechanism for Question Answering(2019)48 cited
• → Non-Factoid Answer Selection in Indonesian Science Question Answering System using Long Short-Term Memory (LSTM)(2021)12 cited
• → Bi-Rank: A New Bi-Directional Ranking Method for Goods Selection(2020)1 cited