HellaSwag: Can a Machine Really Finish Your Sentence?
2019pp. 4791–4800
Citations Over TimeTop 1% of 2019 papers
Abstract
introduced a new task of commonsense natural language inference: given an event description such as "A woman sits at a piano," a machine must select the most likely followup: "She sets her fingers on the keys." With the introduction of BERT (Devlin et al., 2018), near human-level performance was reached. Does this mean that machines can perform human level commonsense inference?