Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Tutorials
2021
Citations Over Time
Andrew Yates, Rodrigo Nogueira, Jimmy Lin, T. B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric J. Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, J. L. Clark, Christopher Berner, Matthew Henderson, Rami Al‐Rfou, Brian Strope, You Kyung Sung, Hassan Sajjad, Narine Kokhlikyan, Fahim Dalvi, Nadir Durrani, Lingfei Wu, Jennifer cohere.com Jennifer cohere.com, Yu Facebook, Heng Ji, Yunyao Li, Paul School, Daria Baidakova, Valentina Fedorova, Heng Ji, Mitesh M. Khapra, Ananya B. Sai, Dalvi, Fahim, Drutsa, Alexey, Durrani, Valentina Fedorova, Hajishirzi, Ji Heng, Mitesh Khapra, Megorskaya, Olga, Peters, Ananya Sai, Sajjad, Hassan, Ustalov, Dmitry, Wu, Lingfei, Yates, Andrew, Luca Soldaini, Alessandro Moschitti, Ledell Wu, Adam Fisch, Sumit Chopra, Keith Adams, Antoine Bordes, Jason Weston, Zhijing Wu, Jiaxin Mao, Yiqun Liu, Jingtao Zhan, Yukun Zheng, Min Zhang, Shaoping Ma, Hamed Zamani, Mostafa Dehghani, W Croft, Erik Learned-Miller, Jaap Kamps, Zhi Zheng, Kai Hui, Ben He, Xianpei Han, Le Sun, Andrew Yates, Anthony Bau, Yonatan Belinkov, Hassan Sajjad, Nadir Durrani, Fahim Dalvi, James Glass, David Bau, Jun-Yan Zhu, Hendrik Strobelt, Agata Lapedriza, Bolei Zhou, Antonio Torralba, Yonatan Belinkov, Sebastian Gehrmann, Ellie Pavlick, Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, Luke Zettlemoyer, Nina Poerner, Benjamin Roth, Hinrich Schtze, Nils Rethmeier, Vageesh Saxena, Isabelle Augenstein, Marco Tlio Ribeiro, Sameer Singh, Carlos Guestrin, Ian Tenney, Dipanjan Das, Ellie Pavlick, Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell, John Wu, Hassan Belinkov, Yonatan Sajjad, Nadir Durrani, Fahim Dalvi, James Glass, Yu Chen, Lingfei Wu, Mohammed Zaki, ;, Yu Chen, Lingfei Wu, Mohammed Zaki, Will Hamilton, Zhitao Ying, Jure Leskovec, Ying Lin, Heng Ji, Fei Huang, Lingfei Wu, Pushpak Ananthakrishnan, Murugesan Bhattacharyya, Ritesh Sasikumar, Shah, Satanjeev Banerjee, Alon Lavie, Chris Callison-Burch, Miles Osborne, Philipp Koehn, Yin Cui, Guandao Yang, Andreas Veit, Xun Huang, Serge Belongie, Bhuwan Dhingra, Manaal Faruqui, P Ankur, Ming-Wei Parikh, Dipanjan Chang, William Das, Cohen, Gregory Druck, Bo Pang, Ondrej Dusek, Jekaterina Novikova, Verena Rieser, Gabriel Forgues, Joelle Pineau, Jean-Marie Larchevque, Ral Tremblay, Matt Kusner, Yu Sun, Nicholas Kolkin, Kilian Weinberger, Chin-Yew Lin, Chia-Wei Liu, Ryan Lowe, Iulian Serban, Michael Noseworthy, Laurent Charlin, Joelle Pineau, Ryan Lowe, Michael Noseworthy, Iulian Vlad Serban, Nicolas Angelard-Gontier, Yoshua Bengio, Joelle Pineau, Qingsong Ma, Yvette Graham, Shugen Wang, Qun Liu, Nitika Mathur, Timothy Baldwin, Trevor Cohn, Preksha Nema, Mitesh Khapra, Kishore Papineni, Salim Roukos, Todd Ward, Wei-Jing Zhu, Maja Popovic, Vasile Rus, C Mihai, Lintean, B Ananya, Mithun Sai, Mitesh Das Gupta, Mukundhan Khapra, Srinivasan, B Ananya, Akash Sai, Siddhartha Kumar Mohankumar, Mitesh Arora, Khapra, Hiroki Shimanaka, Tomoyuki Kajiwara, Mamoru Komachi, Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, John Makhoul, Milos Stanojevic, Khalil Sima'an, Chongyang Tao, Lili Mou, Dongyan Zhao, Rui Yan, Weiyue Wang, Jan-Thorsten Peter, Hendrik Rosendahl, Hermann Ney, John Wieting, Taylor Berg-Kirkpatrick, Kevin Gimpel, Graham Neubig, Ying Zhang, Stephan Vogel, Alex Waibel, Waleed Ammar, Dirk Groeneveld, Chandra Bhagavatula, Iz Beltagy, Miles Crawford, Doug Downey, Jason Dunkelberger, Ahmed Elgohary, Sergey Feldman, Vu Ha, Rodney Kinney, Sebastian Kohlmeier, Kyle Lo, Tyler Murray, Hsu-Han, Matthew Ooi, Joanna Peters, Sam Power, Lucy Skjonsberg, Chris Wang, Zheng Wilhelm, Madeleine Yuan, Oren Van Zuylen, Etzioni, David Bamman, Olivia Lewke, Anya Mansoor, Danqi Chen, Wen-Tau Yih, Arman Cohan, Franck Dernoncourt, Soon Doo, Trung Kim, Seokhwan Bui, Walter Kim, Nazli Chang, Goharian, Zihang Dai, Zhilin Yang, Yiming Yang, Jaime Carbonell, Quoc Le, Ruslan Salakhutdinov, Robin Jia, Cliff Wong, Hoifung Poon, Mandar Joshi, Omer Levy, Luke Zettlemoyer, Daniel Weld, Nikita Kitaev, Lukasz Kaiser, Anselm Levskaya, Toms Kocisk, Jonathan Schwarz, P Blunsom, Chris Dyer, K Hermann, Gbor Melis, Edward Grefenstette, Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, Luke Zettlemoyer, Kyle Lo, Lucy Wang, Mark Neumann, Rodney Kinney, Daniel Weld, Alessandro Sameer Pradhan, Nianwen Moschitti, Olga Xue, Yuchen Uryupina, Zhang, Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, Lukasz Kaiser, Illia Polosukhin, Johannes Welbl, Pontus Stenetorp, Sebastian Riedel, Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William Cohen, Ruslan Salakhutdinov, Christopher Manning, Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, Eduard Hovy, Dmitry Ustalov, ( Phd, Valentina Fedorova, ( Phd, ), Ittai Abraham, S Michael, Bernstein, Chris Biemann, Jonathan Bragg, Chris Callison, - Burch, Mark Dredze, Xi Chen, Justin Cheng, A, Philip Dawid, Allan Skene, Seyda Ertekin, Ujwal Gadiraju, G Panagiotis, Ipeirotis, Jin Yuan, Jiyi Li, Fumiyo Fukumoto, H Christopher, Lin, Greg Little, C Vikas, Raykar, Paul Ruvolo, Aashish Sheshadri, Matthew Lease, Rion Snow, Peter Welinder, Jacob Whitehill, Ming Yin
Abstract
The goal of text ranking is to generate an ordered list of texts retrieved from a corpus in response to a query for a particular task. Although the most common formulation of text ranking is search, instances of the task can also be found in many text processing applications. This tutorial provides an overview of text ranking with neural network architectures known as transformers, of which BERT (Bidirectional Encoder Representations from Transformers) (Devlin et al., 2019) is the best-known example. These models produce high quality results across many domains, tasks, and settings.
Related Papers
- → Introducing Language Technology & Computational Linguistics in Bangladesh(2011)2 cited
- → COMPUTATIONAL LINGUISTICS (Model Baru Kajian Linguistik dalam Perspektif Komputer)(2010)2 cited
- A Detailed Explanation of Computational Linguistics and its Synonyms(2009)
- Linguistics from a Computational Perspective─ Review of Computational Linguistics and Beyond(2005)