Proceedings of the Workshop on Machine Reading for Question Answering
2018
Yichen Gong, Samuel Bowman, Martı́n Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg Cor- Rado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafał Józefowicz, Łukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Mané, Rajat Monga, Sherry Moore, Derek G. Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Tal- War, Paul A. Tucker, Vincent Vanhoucke, Vijay Vasude- Van, Fernanda Viégas, Oriol Vinyals, Pete Warden, Mir Rosenberg, Song Xia, Jianfeng Gao, Saurabh Tiwary, Marc-Antoine Rondeau, Timothy J. Hazen, Seunghak Yu, Sathish Reddy Indurthi, Seohyun Back, Haejun Lee, Jörg Franke, Jan Niehues, Alex Waibel, Michael Boratko, Harshit Padigela, Divyendra Mikkilineni, Pritish Yuvraj, Rajarshi Das, Andrew McCallum, Maria Chang, Achille Fokoue-Nkoutche, Pavan Kapanipathi, Nicholas Mattei, Ryan Musa, Kartik Talamadupula, Michael Witbrock, Boratko Michael, Fokoue-Nkoutche Achille, Franke Jörg, Wei He, Sathish Reddy, Xuan Liu, Wadhwa Soumya, Samuel, Chandu, Khyathi, Chang, Das, Rajarshi, Du, Ye, Fokoue-Nkoutche Achille, Franke Jrg, Gong, Yichen, Wei He, Sathish Reddy, Kapanipathi, Pavan, Lee, Liu, Kai, Xuan Liu, Yuan, Lyu, Yajuan, Mattei, Nicholas, Mikkilineni, Divyendra, Nyberg, Padigela, Ren, Yuanhang, She, Qiaoqiao, Shvartzshanider, Yan, Subramanian, Talamadupula, Kartik, Trischler, Adam, Wadhwa Soumya, Wang, Di, Tong, Wies, Thomas, Witbrock, Michael, Wu, Xiao, Xinyan, Xingdi, Yuvraj, Zhang, Zhao, Shiqi, Robin Jia, Percy Liang, Mandar Joshi, Eunsol Choi, Daniel Weld, Luke Zettlemoyer, Alex Graves, Greg Wayne, Malcolm Reynolds, Tim Harley, Ivo Danihelka, Agnieszka Grabska-Barwiska, Sergio Colmenarejo, Edward Grefenstette, Tiago Ramalho, John Agapiou, Gao Huang, Zhuang Liu, Kilian Weinberger, Laurens Van Der Maaten, Mandar Joshi, Eunsol Choi, Daniel Weld, Luke Zettlemoyer, Ankit Kumar, Ozan Irsoy, Peter Ondruska, Mohit Iyyer, James Bradbury, Ishaan Gulrajani, Victor Zhong, Romain Paulus, Richard Socher, Jeffrey Pennington, Richard Socher, Christopher Manning, Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, Si Wei, Hui Jiang, Diana Inkpen, Eunsol Choi, Daniel Hewlett, Jakob Uszkoreit, Illia Polosukhin, Alexandre Lacoste, Jonathan Berant, John Duchi, Elad Hazan, Yoram Singer, Christoph Goller, Andreas Kchler, Rohit Gupta, Constantin Orasan, Josef Van Genabith, Hua He, Kevin Gimpel, Julie Qiaojin, Lin, Robin Jia, Percy Liang, D Christopher, Mihai Manning, John Surdeanu, Jenny Bauer, Steven Finkel, David Bethard, Mcclosky, Jeffrey Pennington, Richard Socher, Christopher Manning, B Jordan, Pollack, Jinfeng Rao, Hua He, Jimmy Lin, Gehui Shen, Yunlun Yang, Zhi-Hong Deng, Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Richard Socher, Brody Huval, Christopher Manning, Andrew Ng, Richard Socher, Cliff Lin, Chris Manning, Andrew Ng, Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher Manning, Andrew Ng, Christopher Potts, Kai Sheng, Tai, Richard Socher, Christopher Manning, Di Wang, Eric Nyberg, Zhiguo Wang, Wael Hamza, Radu Florian, Xingxing Zhang, Liang Lu, Mirella Lapata, Yiming Cui, Zhipeng Chen, Si Wei, Shijin Wang, Ting Liu, Guoping Hu, Karl Moritz Hermann, Tomas Kocisky, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, Phil Blunsom, Chin-Yew Lin, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Matthew Richardson, J Christopher, Erin Burges, Renshaw, Adam Trischler, Tong Wang, Xingdi Yuan, Justin Harris, Alessandro Sordoni, Philip Bachman, Kaheer Suleman, Shuohang Wang, Jing Jiang, Wenhui Wang, Nan Yang, Furu Wei, Baobao Chang, Ming Zhou, Caiming Xiong, Victor Zhong, Richard Socher, Martn Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dandelion Man, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Vigas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, Xiaoqiang Zheng, Danqi Chen, Jason Bolton, Christopher Manning, Yiming Cui, Zhipeng Chen, Si Wei, Shijin Wang, Ting Liu, Guoping Hu, Bhuwan Dhingra, Hanxiao Liu, Zhilin Yang, William Cohen, Ruslan Salakhutdinov, Alex Graves, Greg Wayne, Malcolm Reynolds, Tim Harley, Ivo Danihelka, Agnieszka Grabska-Barwiska, Sergio Colmenarejo, Edward Grefenstette, Tiago Ramalho, John Agapiou, Karl Moritz Hermann, Tomas Kocisky, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, Phil Blunsom, Rudolf Kadlec, Martin Schmid, Ondej Bajgar, Jan Kleindienst, P Diederik, Jimmy Kingma, Ba, Gnter Klambauer, Thomas Unterthiner, Andreas Mayr, Sepp Hochreiter, Ankit Kumar, Ozan Irsoy, Peter Ondruska, Mohit Iyyer, James Bradbury, Ishaan Gulrajani, Victor Zhong, Romain Paulus, Richard Socher, Jeffrey Pennington, Richard Socher, Christopher Manning, Jack Rae, Jonathan Hunt, Ivo Danihelka, Timothy Harley, Andrew Senior, Gregory Wayne, Alex Graves, Tim Lillicrap, Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, Ruslan Salakhutdinov, Sainbayar Sukhbaatar, Jason Weston, Rob Fergus, Tijmen Tieleman, Geoffrey Hinton, Caiming Xiong, Stephen Merity, Richard Socher, P Clark, P Clark, P Harrison, N Balasubramanian, Peter Clark, Oren Etzioni, V Conitzer, M Rognlie, L Xia, Lynette Hirschman, Marc Light, Eric Breck, John Burger, A Kembhavi, M Seo, D Schwenk, J Choi, A Farhadi, H Hajishirzi, J Kemeny, M Kendall, D Khashabi, T Khot, A Sabharwal, D Roth, Tushar Khot, Ashish Sabharwal, Peter Clark, Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg Corrado, Jeff Dean, Ankur Parikh, Oscar Tckstrm, Dipanjan Das, Jakob Uszkoreit, Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, Percy Liang, Matthew Richardson, J Christopher, Erin Burges, Renshaw, Hai Wang, Mohit Bansal, Kevin Gimpel, David Mcallester, J Welbl, N Liu, M Gardner, H Young, H Young, Adam Barth, Anupam Datta, John Mitchell, Helen Nissenbaum, Jaspreet Bhatia, Travis Breaux, Jaspreet Bhatia, Travis Breaux, Florian Schaub, Jaspreet Bhatia, Morgan Evans, Sudarshan Wadkar, Travis Breaux, Danqi Chen, Adam Fisch, Jason Weston, Antoine Bordes, Omar Chowdhury, Andreas Gampe, Jianwei Niu, Jared Jeffery Von Ronne, Anupam Bennatt, Limin Datta, William Jia, Winsborough, Jaspreet Morgan C Evans, Sudarshan Bhatia, Travis Wadkar, Breaux, Karl Moritz Hermann, Tomas Kocisky, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, Phil Blunsom, Mitra Bokaei Hosseini, Sudarshan Wadkar, Travis Breaux, Jianwei Niu, Gordon Hull, Heather Richter Lipford, Celine Latulipe, Kirsten Martin, Helen Nissenbaum, Jeffrey Pennington, Richard Socher, Christopher Manning, Travis Joel R Reidenberg, Lorrie Breaux, Brian Cranor, Amanda French, James Grannis, Fei Graves, Aleecia Liu, Thomas Mcdonald, Rohan Norton, Ramanath, Pum-Mo Ryu, Myung-Gil Jang, Hyun-Ki Kim, Mysore Kanthashree, Florian Sathyendra, Shomir Schaub, Norman Wilson, Sadeh, Shomir Kanthashree Mysore Sathyendra, Florian Wilson, Sebastian Schaub, Norman Zimmeck, Sadeh, Minjoon Seo, Aniruddha Kembhavi, Ali Farhadi, Hannaneh Hajishirzi, Shomir Wilson, Florian Schaub, Abhilash Aswarth, Frederick Dara, Sushain Liu, Pedro Cherivirala, Mads Giovanni Leon, Sebastian Schaarup Andersen, Zimmeck, Mysore Kanthashree, N Sathyendra, Cameron Russell, Shomir Wilson, Florian Schaub, Rohan Ramanath, Norman Sadeh, Fei Liu, Noah Smith, Frederick Liu, Michael Zimmer, Manish Agarwal, Prashanth Mannem, Husam Ali, Yllias Chali, Sadid Hasan, Lee Becker, Sumit Basu, Lucy Vanderwende, Yllias Chali, Sina Golestanirad, Michael Heilman, Noah Smith ; A, Michael Heilman, Noah Smith, Hidenobu Kunichika, Tomoki Katayama, Tsukasa Hirashima, Akira Takeuchi, Igor Labutov, Sumit Basu, Lucy Vanderwende, Tho Thi, Ngoc Le, Minh Nguyen, Akira Shimazu, David Lindberg, Fred Popowich, John Nesbit, Phil Winne, Wang Ling, Chris Dyer, Alan Black, Isabel Trancoso, Zhiyuan Liu, Xinxiong Chen, Yabin Zheng, Maosong Sun, Patrice Lopez, Laurent Romary, Eibe Olena Medelyan, Ian Frank, Witten, Rui Meng, Sanqiang Zhao, Daqing Han, Peter He, Yu Brusilovsky, Chi, Rada Mihalcea, Paul Tarau, George Miller, Ruslan Mitkov, Le An Ha, Jeffrey Pennington, Richard Socher, Christopher Manning, Ilya Sutskever, Oriol Vinyals, Quoc V Le, Adam Trischler, Tong Wang, Xingdi Yuan, Justin Harris, Alessandro Sordoni, Philip Bachman, Kaheer Suleman, Oriol Vinyals, Meire Fortunato, Navdeep Jaitly, Xiaojun Wan, Jianguo Xiao, Minmei Wang, Bo Zhao, Yihua Huang, Zhilin Yang, Junjie Hu, Ruslan Salakhutdinov, William Cohen, Xingdi Yuan, Tong Wang, Caglar Gulcehre, Alessandro Sordoni, Philip Bachman, Sandeep Subramanian, Saizheng Zhang, Adam Trischler, Daniel Hewlett, Alexandre Lacoste, Llion Jones, Illia Polosukhin, Andrew Fandrianto, Jay Han, Matthew Kelcey, David Berthelot, Anselmo Peas, Eduard Hovy, Pamela Forner, lvaro Rodrigo, F Richard, Corina Sutcliffe, Caroline Forascu, Sporleder, Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, Percy Liang, Wenhui Wang, Nan Yang, Furu Wei, Baobao Chang, Ming Zhou, Satanjeev Banerjee, Alon Lavie, David Chiang, Steve Deneefe, Yee Seng Chan, Hwee Tou Ng, Trang Hoa, Diane Dang, Jimmy Kelly, Lin, Karl Moritz Hermann, Tomas Kocisky, Edward Grefenstette, Lasse Espeholt, Will Kay, Mustafa Suleyman, Phil Blunsom, Philipp Koehn, Chin-Yew Lin, Feifan Liu, Yang Liu, Ani Nenkova, Rebecca Passonneau, Kathleen Mckeown, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Matthew Richardson, J Christopher, Erin Burges, Renshaw, Ellen Voorhees, M Ellen, D Voorhees, Tice, Ellen Voorhees, Wenhui Wang, Nan Yang, Furu Wei, Baobao Chang, Ming Zhou Abstract
To answer the question in machine comprehension (MC) task, the models need to establish the interaction between the question and the context.To tackle the problem that the single-pass model cannot reflect on and correct its answer, we present Ruminating Reader.Ruminating Reader adds a second pass of attention and a novel information fusion component to the Bi-Directional Attention Flow model (BIDAF).We propose novel layer structures that construct a query aware context vector representation and fuse encoding representation with intermediate representation on top of BIDAF model.We show that a multi-hop attention mechanism can be applied to a bi-directional attention structure.In experiments on SQuAD, we find that the Reader outperforms the BIDAF baseline by 2.1 F1 score and 2.7 EM score.Our analysis shows that different hops of the attention have different responsibilities in selecting answers.