MR-RawNet: Speaker verification system with multiple temporal resolutions for variable duration utterances using raw waveforms

  • Seung Bin Kim
  • , Chan Yeong Lim
  • , Jungwoo Heo
  • , Ju Ho Kim
  • , Hyun Seo Shin
  • , Kyo Won Koo
  • , Ha Jin Yu

Research output: Contribution to journalConference articlepeer-review

1 Scopus citations

Abstract

In speaker verification systems, the utilization of short utterances presents a persistent challenge, leading to performance degradation primarily due to insufficient phonetic information to characterize the speakers. To overcome this obstacle, we propose a novel structure, MR-RawNet, designed to enhance the robustness of speaker verification systems against variable duration utterances using raw waveforms. The MR-RawNet extracts time-frequency representations from raw waveforms via a multi-resolution feature extractor that optimally adjusts both temporal and spectral resolutions simultaneously. Furthermore, we apply a multi-resolution attention block that focuses on diverse and extensive temporal contexts, ensuring robustness against changes in utterance length. The experimental results, conducted on VoxCeleb1 dataset, demonstrate that the MR-RawNet exhibits superior performance in handling utterances of variable duration compared to other raw waveform-based systems.

Original languageEnglish
Pages (from-to)2125-2129
Number of pages5
JournalProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
DOIs
StatePublished - 2024
Event25th Interspeech Conferece 2024 - Kos Island, Greece
Duration: 1 Sep 20245 Sep 2024

Keywords

  • multi resolution
  • raw waveform
  • short duration
  • speaker verification

Fingerprint

Dive into the research topics of 'MR-RawNet: Speaker verification system with multiple temporal resolutions for variable duration utterances using raw waveforms'. Together they form a unique fingerprint.

Cite this