On-the-Fly Audio Source Separation—A Novel User-Friendly Framework

Citations Over TimeTop 14% of 2016 papers

Abstract

This paper addresses the challenging problem of single-channel audio source separation. We introduce a novel user-guided framework where source models that govern the separation process are learned on-the-fly from audio examples retrieved online. The user only provides the search keywords that describe the sources in the mixture. In this framework, the generic spectral characteristics of each source are modeled by a universal sound class model learned from the retrieved examples via nonnegative matrix factorization. We propose several group sparsity-inducing constraints in order to efficiently exploit a relevant subset of the universal model adapted to the mixture to be separated. We then derive the corresponding multiplicative update rules for parameter estimation. Separation results obtained from automated and user tests on mixtures containing various types of sounds confirm the effectiveness of the proposed framework.

Related Papers

• → Score informed audio source separation using constrained nonnegative matrix factorization and score synthesis(2013)61 cited
• → Audio Source Separation Based on Nonnegative Matrix Factorization with Graph Harmonic Structure(2018)7 cited
• → Sparsity promoted non-negative matrix factorization for source separation and detection(2014)3 cited
• → A comparative study of example-guided audio source separation approaches based on nonnegative matrix factorization(2017)1 cited
• → Audio Source Separation Method Based on Beamspace-domain Multichannel Non-negative Matrix Factorization, Part I: Beamspace-domain Multichannel Non-negative Matrix Factorization system(2012)