The Unreasonable Effectiveness of the Baseline: Discussing SVMs in Legal Text Classification

Citations Over TimeTop 1% of 2021 papers

Abstract

We aim to highlight an interesting trend to contribute to the ongoing debate around advances within legal Natural Language Processing. Recently, the focus for most legal text classification tasks has shifted towards large pre-trained deep learning models such as BERT. In this paper, we show that a more traditional approach based on Support Vector Machine classifiers reaches competitive performance with deep learning models. We also highlight that error reduction obtained by using specialised BERT-based models over baselines is noticeably smaller in the legal domain when compared to general language tasks. We discuss some hypotheses for these results to support future discussions.

Related Papers

• → Accounting for baseline targets in NDCs(2018)3 cited
• Method for Improvement of Baseline Resolving Quality in GPS Measurement(2007)
• Analysis of the Baseline Decorrelation and Critical Baseline of Interferometric SAR(2003)
• Research of Baseline Implement(2010)
• Study and application of telecom operators system security state baseline(2012)