On the effect of the label bias problem in part-of-speech tagging

Citations Over TimeTop 12% of 2013 papers

Abstract

This paper investigates the effect of the label bias problem of maximum entropy Markov models for part-of-speech tagging, a typical sequence prediction task in natural language processing. This problem has been underexploited and underappreciated. The investigation reveals useful information about the entropy of local transition probability distributions of the tagging model which enables us to exploit and quantify the label bias effect of part-of-speech tagging. Experiments on a Vietnamese treebank and on a French treebank show a significant effect of the label bias problem in both of the languages.

Related Papers

• → On the effect of the label bias problem in part-of-speech tagging(2013)7 cited
• A Chinese Part of Speech Tagging Method Based on Maximum Entropy Principle(2004)
• → Chinese part of speech tagging based on maximum entropy method(2003)4 cited
• → Mongolian Part-of-Speech Tagging with Neural Networks(2021)2 cited