MFA-Conformer: Multi-scale Feature Aggregation Conformer for Automatic Speaker Verification

Citations Over TimeTop 1% of 2022 papers

Abstract

In this paper, we present Multi-scale Feature Aggregation Conformer (MFA-Conformer), an easy-to-implement, simple but effective backbone for automatic speaker verification based on the Convolution-augmented Transformer (Conformer).The architecture of the MFA-Conformer is inspired by recent stateof-the-art models in speech recognition and speaker verification.Firstly, we introduce a convolution subsampling layer to decrease the computational cost of the model.Secondly, we adopt Conformer blocks which combine Transformers and convolution neural networks (CNNs) to capture global and local features effectively.Finally, the output feature maps from all Conformer blocks are concatenated to aggregate multi-scale representations before final pooling.We evaluate the MFA-Conformer on the widely used benchmarks.The best system obtains 0.64%, 1.29% and 1.63% EER on VoxCeleb1-O, SITW.Dev, and SITW.Eval set, respectively.MFA-Conformer significantly outperforms the popular ECAPA-TDNN systems in both recognition performance and inference speed.Last but not the least, the ablation studies clearly demonstrate that the combination of global and local feature learning can lead to robust and accurate speaker embedding extraction.We have also released the code 1 for future comparison.

Related Papers

• → Structural information from OH stretching vibrations—XVII. On the different conformers in benzylalcohols and anthracylmethanols(1986)22 cited
• → Relative energies, stereoelectronic interactions and conformational interconversions in silathiacyclohexanes(2004)15 cited
• → Effects of side chains in gas-phase amino acids: Conformational analysis and relative stabilities(2009)7 cited
• → Conformation and vibrational spectra of 1,2-diisocyanoethane(1982)7 cited
• → ChemInform Abstract: CONFORMATION AND VIBRATIONAL SPECTRA OF 1,2‐DIISOCYANOETHANE(1982)