Model-Based Expectation-Maximization Source Separation and Localization

Citations Over TimeTop 10% of 2009 papers

Abstract

This paper describes a system, referred to as model-based expectation-maximization source separation and localization (MESSL), for separating and localizing multiple sound sources from an underdetermined reverberant two-channel recording. By clustering individual spectrogram points based on their interaural phase and level differences, MESSL generates masks that can be used to isolate individual sound sources. We first describe a probabilistic model of interaural parameters that can be evaluated at individual spectrogram points. By creating a mixture of these models over sources and delays, the multi-source localization problem is reduced to a collection of single source problems. We derive an expectation-maximization algorithm for computing the maximum-likelihood parameters of this mixture model, and show that these parameters correspond well with interaural parameters measured in isolation. As a byproduct of fitting this mixture model, the algorithm creates probabilistic spectrogram masks that can be used for source separation. In simulated anechoic and reverberant environments, separations using MESSL produced on average a signal-to-distortion ratio 1.6 dB greater and perceptual evaluation of speech quality (PESQ) results 0.27 mean opinion score units greater than four comparable algorithms.

Related Papers

• → Determined Audio Source Separation with Multichannel Star Generative Adversarial Network(2020)11 cited
• → End-to-End Music Source Separation: Is it Possible in the Waveform Domain?(2019)12 cited
• → CatNet: music source separation system with mix-audio augmentation(2021)9 cited
• → Spectrogram-channels u-net: a source separation model viewing each\n channel as the spectrogram of each source(2018)3 cited
• → Spectrogram-channels u-net: a source separation model viewing each channel as the spectrogram of each source(2018)1 cited