Accelerating literature curation with text-mining tools: a case study of using PubTator to curate genes in PubMed abstracts

Citations Over TimeTop 10% of 2012 papers

Abstract

Today's biomedical research has become heavily dependent on access to the biological knowledge encoded in expert curated biological databases. As the volume of biological literature grows rapidly, it becomes increasingly difficult for biocurators to keep up with the literature because manual curation is an expensive and time-consuming endeavour. Past research has suggested that computer-assisted curation can improve efficiency, but few text-mining systems have been formally evaluated in this regard. Through participation in the interactive text-mining track of the BioCreative 2012 workshop, we developed PubTator, a PubMed-like system that assists with two specific human curation tasks: document triage and bioconcept annotation. On the basis of evaluation results from two external user groups, we find that the accuracy of PubTator-assisted curation is comparable with that of manual curation and that PubTator can significantly increase human curatorial speed. These encouraging findings warrant further investigation with a larger number of publications to be annotated. Database URL: http://www.ncbi.nlm.nih.gov/CBBresearch/Lu/Demo/PubTator/

Related Papers

• → Assisting manual literature curation for protein-protein interactions using BioQRator(2014)37 cited
• → Accessible data curation and analytics for international-scale citizen science datasets(2021)7 cited
• Big data curation(2014)
• → Parameter tuning: Exposing the gap between data curation and effective data analytics(2014)1 cited
• → Workshop on Human-in-the-loop Data Curation(2022)1 cited