0 citations0 references

Pyserini: A Python Toolkit for Reproducible Information Retrieval Research with Sparse and Dense Representations

2021pp. 2356–2362

Citations Over TimeTop 1% of 2021 papers

Jimmy Lin, Xueguang Ma, Sheng-Chieh Lin, Jheng-Hong Yang, Ronak Pradeep, Rodrigo Nogueira

Abstract

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations. It aims to provide effective, reproducible, and easy-to-use first-stage retrieval in a multi-stage ranking architecture. Our toolkit is self-contained as a standard Python package and comes with queries, relevance judgments, pre-built indexes, and evaluation scripts for many commonly used IR test collections. We aim to support, out of the box, the entire research lifecycle of efforts aimed at improving ranking with modern neural approaches. In particular, Pyserini supports sparse retrieval (e.g., BM25 scoring using bag-of-words representations), dense retrieval (e.g., nearest-neighbor search on transformer-encoded representations), as well as hybrid retrieval that integrates both approaches. This paper provides an overview of toolkit features and presents empirical results that illustrate its effectiveness on two popular ranking tasks. Around this toolkit, our group has built a culture of reproducibility through shared norms and tools that enable rigorous automated testing.

Related Papers

USING PYTHON AND EPPY FOR A LARGE NATIONAL SIMULATION STUDY(2016)
→ Data analysis with MATLAB® or Python(2022)4 cited
→ Appendix E: Modelica and Python Scripting(2014)
→ Scripting(2011)
→ Critiquing Computing Artifacts through Programming Satirical Python Scripts(2023)