Short Utterance Compensation in Speaker Verification via Cosine-Based Teacher-Student Learning of Speaker Embeddings

Citations Over TimeTop 10% of 2019 papers

Abstract

The short duration of an input utterance is one of the most critical threats that degrade the performance of speaker verification systems. This study aimed to develop an integrated text-independent speaker verification system that inputs utterances with short duration of 2 seconds or less. We propose an approach using a teacher-student learning framework for this goal, applied to short utterance compensation for the first time in our knowledge. The core concept of the proposed system is to conduct the compensation throughout the network that extracts the speaker embedding, mainly in phonetic-level, rather than compensating via a separate system after extracting the speaker embedding. In the proposed architecture, phonetic-level features where each feature represents a segment of 130 ms are extracted using convolutional layers. A layer of gated recurrent units extracts an utterance-level feature using phonetic-level features. The proposed approach also adopts a new objective function for teacher-student learning that considers both Kullback-Leibler divergence of output layers and cosine distance of speaker embeddings layers. Experiments were conducted using deep neural networks that take raw waveforms as input, and output speaker embeddings on VoxCelebl dataset. The proposed model showed 16.6 % relative improvement compared to a baseline approach.

Related Papers

• → Similarity measures of intuitionistic fuzzy sets based on cosine function for the decision making of mechanical design schemes(2015)83 cited
• → Leveraging speaker diarization for meeting recognition from distant microphones(2010)19 cited
• → Incremental Cosine Computations for Search and Exploration of Tag Spaces(2012)4 cited
• → Speaker Recognition and Diarization(2010)3 cited
• → On the benchmarking of port performance. A cosine similarity approach(2019)