Skip to main navigation Skip to search Skip to main content

Token-based Attractors and Cross-attention in Spoof Diarization

  • Kyo Won Koo
  • , Chan Yeong Lim
  • , Jee Weon Jun
  • , Hye Jin Shim
  • , Ha Jin Yu
  • University of Seoul
  • Carnegie Mellon University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Spoof diarization identifies 'what spoofed when' in a given speech by temporally locating spoofed regions and determining their manipulation techniques. As a first step toward this task, prior work proposed a two-branch model for localization and spoof type clustering, which laid the foundation for spoof diarization. However, its simple structure limits the ability to capture complex spoofing patterns and lacks explicit reference points for distinguishing between bona fide and various spoofing types. To address these limitations, our approach introduces learnable tokens where each token represents acoustic features of bona fide and spoofed speech. These attractors interact with frame-level embeddings to extract discriminative representations, improving separation between genuine and generated speech. Vast experiments on PartialSpoof dataset consistently demon-strate that our approach outperforms existing methods in bona fide detection and spoofing method clustering.

Original languageEnglish
Title of host publicationASRU 2025 - 2025 IEEE Automatic Speech Recognition and Understanding Workshop
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331544263
DOIs
StatePublished - 2025
Event2025 IEEE Automatic Speech Recognition and Understanding Workshop, ASRU 2025 - Honolulu, United States
Duration: 6 Dec 202510 Dec 2025

Publication series

NameASRU 2025 - 2025 IEEE Automatic Speech Recognition and Understanding Workshop

Conference

Conference2025 IEEE Automatic Speech Recognition and Understanding Workshop, ASRU 2025
Country/TerritoryUnited States
CityHonolulu
Period6/12/2510/12/25

Keywords

  • Attractor tokens
  • Cross-attention
  • Speaker diarization
  • Spoof diarization

Fingerprint

Dive into the research topics of 'Token-based Attractors and Cross-attention in Spoof Diarization'. Together they form a unique fingerprint.

Cite this