An Information Retrieval Pipeline for Legislative Documents from the Brazilian Chamber of Deputies
Citations Over TimeTop 1% of 2021 papers
Abstract
This work investigates information retrieval methods to address the existing difficulties on the Preliminary Search, part of the law making process from the Brazilian Chamber of Deputies. For such, different preprocessing approaches, stemmers, language models, and BM25 variants were compared. Two legislative corpora from Chamber were used to build and validate the pipeline. All texts were converted to lowercase and had stopwords, accentuation, and punctuation removed. Words were represented by their stem combined with word unigram and bigram language models. Retrieving the bill that was originated from a specific job request, the BM25L with Savoy stemmer reached a R@20 of 0.7356. After removing queries with inconsistencies or which made reference exclusively to attachments, to other job requests, or to bills, the R@20 increased to 0.94.
Related Papers
- → For a psycholinguistic model of handwriting production: Testing the syllable-bigram controversy.(2011)88 cited
- Topic Models: Accounting Component Structure of Bigrams(2015)
- Back-off bigram을 이용한 대용량 연속어의 화자적응에 관한 연구(2003)
- → A Corpus-Based Study of the Rate of Changes in Frequency of Syntactic Bigrams in English and Russian(2019)