Abstract Speaker-conditioned target speaker extraction aims at estimating the target speaker from a mixture of speakers utilizing auxiliary information about the target speaker. In this paper, we consider a single-channel target speaker extraction system consisting of a speaker embedder network and a speaker separator network. Instead of using standard long short-term memory (LSTM) cells in the separator network, we propose two variants of LSTM cells that are customized for speaker-conditioned target speaker extraction. The first variant customizes both the forget gate and input gate of the LSTM cell, aiming at retaining only relevant features related to target speaker and disregarding the interfering speakers by simultaneously resetting and updating the cell state using the speaker embedding. For the second variant, we introduce a new gate within the LSTM cell, referred to as auxiliary-modulation gate. This gate modulates the information processing during cell state reset, aiming at learning the long-term and short-term discriminative features of the target speaker. Both in unidirectional and bidirectional mode, experimental results on 2-speaker mixtures, 3-speaker mixtures, and noisy mixtures (containing 1, 2, or 3 speakers) show that both proposed variants of LSTM cells outperform the standard LSTM cells for target speaker extraction, where the best performance is obtained using the auxiliary-gated LSTM cells.

Ragini Sinha

Christian Rollwage

Simon Doclo

EURASIP Journal on Audio Speech and Music Processing

“EURASIP JOURNAL ON AUDIO, SPEECH, AND MUSIC PROCESSING”旨在汇集致力于各种音频信号处理理论和应用的研究人员、科学家和工程师，特别关注语音和音乐。 EURASIP 音频、语音和音乐处理期刊将是一本跨学科期刊，用于传播语音通信和音频处理的所有基本和应用方面。

The "Eurasip Journal on Audio, Speech, and Music Processing" aims to bring together researchers, scientists, and engineers dedicated to the theory and application of various audio signal processing, with a particular focus on speech and music. This journal will serve as an interdisciplinary platform for disseminating all fundamental and applied aspects of speech communication and audio processing.

《Eurasip Journal on Audio, Speech, and Music Processing》旨在汇聚致力于音频信号处理理论与应用的研究人员、科学家和工程师，特别关注语音和音乐领域。该期刊将作为一个跨学科的平台，传播语音通信和音频处理的基本理论及其应用。

Category	Quartile
计算机科学	3
计算机科学, 声学	3
计算机科学, 工程电子与电气	3

Variants of LSTM cells for single-channel speaker-conditioned target speaker extraction

ivySCI AI Smartly Parses PDF, Answers Researchers' Questions, and Helps You Understand Papers in Seconds

Journal Info

Category	Quartile
ENGINEERING, ELECTRICAL & ELECTRONIC	3