Papers
On the reliability of feature attribution methods for speech classification
Gaofei Shen, Hosein Mohebbi, Arianna Bisazza et al.
What do self-supervised speech models know about Dutch? Analyzing advantages of language-specific pre-training
Marianne de Heer Kloots, Hosein Mohebbi, Charlotte Pouw et al.
Word stress in self-supervised speech models: A cross-linguistic comparison
Martijn Bentum, Louis ten Bosch, Tomas O. Lentz
Effective Context in Neural Speech Models
Yen Meng, Sharon Goldwater, Hao Tang
From Words to Waves: Analyzing Concept Formation in Speech and Text-Based Foundation Models
Asim Ersoy, Basel Ahmad Mousi, Shammur Absar Chowdhury et al.
Semantic-Aware Interpretable Multimodal Music Auto-Tagging
Andreas Patakis, Vassilis Lyberatos, Spyridon Kantarelis et al.
Is your model big enough? Training and interpreting large-scale monolingual speech foundation models
Yaroslav Getman, Tamás Grósz, Tommi Lehtonen et al.
Analysis of Semantic and Acoustic Token Variability Across Speech, Music, and Audio Domains
Takanori Ashihara, Marc Delcroix, Tsubasa Ochiai et al.
Discrete Tokens Exhibit Interlanguage Speech Intelligibility Benefit: an Analytical Study Towards Accent-robust ASR Only with Native Speech Data
Kentaro Onda, Keisuke Imoto, Satoru Fukayama et al.
Spectrotemporal Modulation: Efficient and Interpretable Feature Representation for Classifying Speech, Music, and Environmental Sounds
Andrew Chang, Yike Li, Iran R. Roman et al.
Benchmarking Time-localized Explanations for Audio Classification Models
Cecilia Bolaños, Leonardo Pepino, Martin Meza et al.
Echoes of Phonetics: Unveiling Relevant Acoustic Cues for ASR via Feature Attribution
Dennis Fucci, Marco Gaido, Matteo Negri et al.
EnvSDD: Benchmarking Environmental Sound Deepfake Detection
Han Yin, Yang Xiao, Rohan Kumar Das et al.
Pull It Together: Reducing the Modality Gap in Contrastive Learning
Amit Sofer, Yoav Goldman, Shlomo E. Chazan
Towards Diverse and Efficient Audio Captioning via Diffusion Models
Manjie Xu, Chenxing Li, Yong Ren et al.
FFD: Fine-Finger Diffusion Model for Music to Fine-grained Finger Dance Generation
Boya Dong, Wentao Lei, Li Liu
PersonaTAB: Predicting Personality Traits using Textual, Acoustic, and Behavioral Cues in Fully-Duplex Speech Dialogs
Sho Inoue, Shuai Wang, Haizhou Li
FD-Bench: A Full-Duplex Benchmarking Pipeline Designed for Full Duplex Spoken Dialogue Systems
Yizhou Peng, Yi-Wen Chao, Dianwen Ng et al.
GALAXY: A Large-Scale Open-Domain Dataset for Multimodal Learning
Yihan Wu, Yichen Lu, Yijing Chen et al.
ViCocktail: Automated Multi-Modal Data Collection for Vietnamese Audio-Visual Speech Recognition
Thai-Binh Nguyen, Thi Van Nguyen, Quoc Truong Do et al.
Mitigating Audiovisual Mismatch in Visual-Guide Audio Captioning
Le Xu, Chenxing Li, Yong Ren et al.
Hearing from Silence: Reasoning Audio Descriptions from Silent Videos via Vision-Language Model
Yong Ren, Chenxing Li, Le Xu et al.
Learning More with Less: Self-Supervised Approaches forLow-Resource Speech Emotion Recognition
Ziwei Gong, Pengyuan Shi, Kaan Donbekci et al.
Multi-Teacher Language-Aware Knowledge Distillation for Multilingual Speech Emotion Recognition
Mehedi Hasan Bijoy, Dejan Porjazovski, Tamás Grósz et al.