Confidence scoring for speech understanding systems
Citations Over TimeTop 10% of 1998 papers
Abstract
This research investigates the use of utterance-level features for confidence scoring. Confidence scores are used to accept or reject user utterances in our conversational weather information system [10]. We have developed an automatic labeling algorithm based on a semantic frame comparison between recognized and transcribed orthographies. We explore recognition-based features along with semantic, linguistic, and application-specific features for utterance rejection. Discriminant analysis is used in an iterative process to select the best set of classification features for our utterance rejection sub-system. Experiments show that we can correctly reject over 60% of incorrectly understood utterances while accepting 98% of all correctly understood utterances.
Related Papers
- → A puzzle about accommodation and truth(2021)16 cited
- → Analysis of User Reactions to Turn-Taking Failures in Spoken Dialogue Systems(2007)10 cited
- → A computational model of incremental utterance production in task-oriented dialogues(1996)7 cited
- → Source memorization in chat interactions(2007)1 cited
- Non-language Process in Utterance Communication(2005)