Interspeech 2025

1,179 papers

Frozen Large Language Models Can Perceive Paralinguistic Aspects of Speech

Wonjune Kang, Junteng Jia, Chunyang Wu, Wei Zhou, Egor Lakomkin

Clinical Annotations for Automatic Stuttering Severity Assessment

Ana Valente, Rufael Marew, Hawau Toyin, Hamdan Al-Ali, Anelise Bohnen

Multimodal Fusion with Semi-Supervised Learning Minimizes Annotation Quantity for Modeling Videoconference Conversation Experience

Andrew Chang, Chenkai Hu, Ji Qi, Zhuojian Wei, KeXin Zhang

MIKU-PAL: An Automated and Standardized Multimodal Method for Speech Paralinguistic and Affect Labeling

Yifan Cheng, Ruoyi Zhang, Jiatong Shi

From Scarcity to Sufficiency: Speech Recognition Pipeline for Zero-resource Language

Nikolay Karpov, Sofia Kostandian, Nune Tadevosyan, Alexan Ayrapetyan, Andrei Andrusenko

Optimizing ASR for Catalan-Spanish Code-Switching: A Comparative Analysis of Methodologies

Carlos Mena, Pol Serra, Jacobo Romero, Abir Messaoudi, José Giraldo

Adapting Whisper for low-resource Hindi-English Code-Mix speech with on-the-fly Augmentation & LLM-Synthesised Data

Astik Biswas, Oleg Shevelev, Amine Abdaoui, Vivek Tyagi, Abdelmoumene Boumadane

Whilter: A Whisper-based Data Filter for "In-the-Wild" Speech Corpora Using Utterance-level Multi-Task Classification

William Ravenscroft, George Close, Kit Bower-Morris, Jamie Stacey, Dmitry Sityaev

Hybrid Data Sampling for ASR: Integrating Acoustic Diversity and Transcription Uncertainty

Komei Hiruta, Yosuke Yamano, Hideaki Tamori

A semi-automatic pipeline for transcribing and segmenting child speech

Polychronia Christodoulidou, James Tanner, Jane Stuart-Smith, Michael McAuliffe, Mridhula Murali

ASR-based segmentation for the analysis of larger child-speech datasets: Performance evaluation on vowels from Australian-English speaking children aged 4 to 11 years

Rui Cai, Titia Benders

AusKidTalk: Using Strategic Data Collection and Out-of-Domain Tools to Semi-Automate Novel Corpora Annotation

Tünde Szalay, Mostafa Shahin, Tharmakulasingam Sirojan, Zheng Nan, Renata Huang

Auto-Landmark: Acoustic Landmark Dataset and Open-Source Toolkit for Landmark Extraction

Xiangyu Zhang, Daijiao Liu, Tianyi Xiao, Cihan Xiao, Tünde Szalay

Automatic Labeling and Correction of Noisy Labels for Robust Self-Supervised Speaker Verification

Abderrahim Fathan, Jahangir Alam

An Exploratory Framework for LLM-assisted Human Annotation of Speech Datasets

Alexander Johnson, Harsh Deshpande, Emmy Phung, Ahmad Emami

Augment Mandarin to Cantonese Speech Databases via Retrieval-Augmented Generation and Speech Synthesis

Fan LIU, Cheng Gong, Boyu Zhu, Ruihao Jing, Chunyu Qiang

Recognizing Every Voice: Towards Inclusive ASR for Rural Bhojpuri Women

Sakshi Joshi, Eldho Ittan George, Tahir Javed, Kaushal Bhogale, Nikhil Narasimhan

You Are What You Say: Exploiting Linguistic Content for VoicePrivacy Attacks

Ünal Ege Gaznepoglu, Anna Leschanowsky, Ahmad Aloradi, Prachi Singh, Daniel Tenbrinck

EzAudio: Enhancing Text-to-Audio Generation with Efficient Diffusion Transformer

Jiarui Hai, Yong Xu, Hao Zhang, Chenxing Li, Helin Wang

TTMBA: Towards Text To Multiple Sources Binaural Audio Generation

Yuxuan He, Xiaoran Yang, Ningning Pan, Gongping Huang

Video-to-Audio Generation with Fine-grained Temporal Semantics

Yuchen Hu, Yu Gu, Chenxing Li, Rilin Chen, Dong Yu

FoleyMaster: High-Quality Video-to-Audio Synthesis via MLLM-Augmented Prompt Tuning and Joint Semantic-Temporal Adaptation

Liming Liang, Luo Chen, Yuehan Jin, Xianwei Zhuang, Yuxin Xie

InfiniteAudio: Infinite-Length Audio Generation with Consistency

Chaeyoung Jung, Hojoon Ki, Ji-Hoon Kim, Junmo Kim, Joon Son Chung

Discovering Directions of Uncertainty in Speech Inpainting

Kfir Cohen, Lior Wolf, Bracha Laufer-Goldshtein

Robustness of F0 Ratio as a Diagnostic: Comparing Creaky Voice in Danish and Seoul Korean

Michaela Watkins, Rasmus Puggaard-Rode, Paul Boersma, Silke Hamann

Evaluating the suitability of acoustic parameters for capturing breathy voice in non-pathological female speakers

Chloe Patman, Paul Foulkes, Kirsty McDougall

Exploratory Study of Filled Pauses in Ukrainian Language: Phonetic Properties of Filled Pauses

Anna Havras, Carlos Mendes, Helena Moniz, Gueorgui Hristovsky, João Miranda

Sounding Like a Winner? Prosodic Differences in Post-Match Interviews

Sofoklis Kakouros, Haoyu Chen

Tonal Variation and Word Meaning in Taiwanese

Yu-Ying Chuang, Sheng-Fu Wang

Corpus-Based Insights into Mandarin Neutral Tone: Effects of Tonal Context and Structural Patterns in Spontaneous Speech

Jingyi Sun, Nicolas Audibert, Yaru Wu, Martine Adda-Decker

Tone recognition in low-resource languages of North-East India: peeling the layers of SSL-based speech models

Parismita Gogoi, Sishir Kalita, Wendy Lalhminghlui, Viyazonuo Terhiija, Moakala Tzudir

Zero-Shot Mono-to-Binaural Speech Synthesis

Alon Levkovitch, Julian Salazar, Soroosh Mariooryad, RJ Skerry-Ryan, Nadav Bar

Streaming Non-Autoregressive Model for Accent Conversion and Pronunciation Improvement

Tuan-Nam Nguyen, Ngoc-Quan Pham, Seymanur Akti, Alexander Waibel

EEG-based Voice Conversion : Hearing the Voice of Your Brain

Yizhong Geng, Wenxin Fu, Qihang Lu, Bingsong Bai, Cong Wang

When Humans Growl and Birds Speak: High-Fidelity Voice Conversion from Human to Animal and Designed Sounds

Minsu Kang, Seolhee Lee, Choonghyeon Lee, Namhyun Cho

Gradual modeling of the Lombard effect by modifying speaker embeddings from a Text-To-Speech model

Thiago Henrique Gomes Lobato, Magnus Schäfer

Voice Adaptation for Swiss German

Samuel Stucki, Jan Deriu, Mark Cieliebak

Can We Reconstruct a Dysarthric Voice with the Large Speech Model Parler TTS?

Ariadna Sánchez, Simon King

Kinship in Speech: Leveraging Linguistic Relatedness for Zero-Shot TTS in Indian Languages

Utkarsh Pathak, Chandra Sai Krishna Gunda, Anusha Prakash, Keshav Agarwal, Hema A. Murthy

Rasmalai : Resources for Adaptive Speech Modeling in IndiAn Languages with Accents and Intonations

Ashwin Sankar, Yoach Lacombe, Sherry Thomas, Praveen Srinivasa Varadhan, Sanchit Gandhi

“KAN you hear me?” Exploring Kolmogorov-Arnold Networks for Spoken Language Understanding

Alkis Koudounas, Moreno La Quatra, Eliana Pastor, Sabato Marco Siniscalchi, Elena Baralis

DRI-GAN: A Novel Dual Real Input GAN with Triplet Loss for Cross-Lingual and Noisy SLU

Ankit Kumar, Munir Georges

Modeling Multi-Turn Spoken Language Understanding with Dynamic Graph Convolutional Networks

Yi Huang, Si Chen, Jingyu Yao, Junlan Feng

Leveraging Information Retrieval to Enhance Spoken Language Understanding Prompts in Few-Shot Learning

Pierre Lepagnol, Sahar Ghannay, Thomas Gerald, Christophe Servan, Sophie Rosset

Spoken Language Understanding on Unseen Tasks With In-Context Learning

Neeraj Agrawal, Sriram Ganapathy

QUADS: Quantized Distillation Framework for Efficient Speech Language Understanding

Subrata Biswas, Mohammad Nur Hossain Khan, Bashima Islam

Frequency-Domain Enhanced Extreme Bandwidth Extension Network with ICCRN for Superior Speech Quality

Hongtao Bao, Xueliang Zhang

HWB-Net: A Novel High-Performance and Efficient Hybrid Waveform Bandwidth Extension Method

Xin Liu, Shulin He, Xueliang Zhang

A Neural Codec Approach for Noise-Robust Bandwidth Expansion

Xi Liu, Mu Yang, Szu-Jui Chen, John H.L. Hansen

MDDM: A Multi-view Discriminative Enhanced Diffusion-based Model for Speech Enhancement

Nan Xu, Zhaolong Huang, Xiaonan Zhi

SNR-Aligned Consistent Diffusion for Adaptive Speech Enhancement

Yonghyeon Jun, Beomjun Woo, Myeonghun Jeong, Namsoo Kim

Voice-ENHANCE: Speech Restoration using a Diffusion-based Voice Conversion Framework

Kyungguen Byun, Jason Filos, Erik Visser, Sunkuk Moon

A Semantic Information-based Hierarchical Speech Enhancement Method Using Factorized Codec and Diffusion Model

Yang Xiang, Canan Huang, Desheng Hu, Jingguang Tian, Xinhui Hu

CEREALES : a new dataset of Quebec French accented speech with applications to speech recognition

Lucas Maison, Thomas Soulas, Marie-Jean Meurs

Loquacious Set: 25,000 Hours of Transcribed and Diverse English Speech Recognition Data for Research and Commercial Use

Titouan Parcollet, Yuan Tseng, Shucong Zhang, Rogier C. van Dalen

SPGISpeech 2.0: Transcribed multi-speaker financial audio for speaker-tagged transcription

Raymond Grossman, Taejin Park, Kunal Dhawan, Andrew Titus, Sophia Zhi

BR-ASR: Efficient and Scalable Bias Retrieval Framework for Contextual Biasing ASR in Speech LLM

Xun Gong, Anqi Lv, Wangyou Zhang, Zhiming Wang, Huijia Zhu

Towards High-Quality LLM-Based Data for French Spontaneous Speech Simplification: an Exo-Refinement Approach

Lucía Ormaechea, Nikos Tsourakis, Pierrette Bouillon, Benjamin Lecouteux, Didier Schwab

LHCP-ASR: An English Speech Corpus of High-Energy Particle Physics Talks for Narrow-Domain ASR Benchmarking

Jaume Santamaría-Jordà, Pablo Segovia-Martínez, Gonçal V. Garcés Díaz-Munío, Joan Albert Silvestre-Cerdà, Adrià Giménez

The Faetar Speech Recognition Benchmark

Michael Ong, Sean Robertson, Leo Peckham, Alba Jorquera Jimenez de Aberasturi, Paula Arkhangorodsky

AfriHuBERT: A self-supervised speech representation model for African languages

Jesujoba O. Alabi, Xuechen Liu, Dietrich Klakow, Junichi Yamagishi

Self-Supervised Models of Speech Processing for Haitian Creole

William N. Havard, Renauld Govain, Benjamin Lecouteux, Emmanuel Schang

ViToSA: Audio-Based Toxic Spans Detection on Vietnamese Speech Utterances

Huy Ba Do, Vy Le-Phuong Huynh, Luan Thanh Nguyen

ToxicTone: A Mandarin Audio Dataset Annotated for Toxicity and Toxic Utterance Tonality

Yu-Xiang Luo, Yi-Cheng Lin, Ming-To Chuang, Jia-Hung Chen, I-Ning Tsai

The Sub-3Sec Problem: From Text-Independent to Text-Dependent Corpus

Ruichen Zuo, Kong Aik Lee, Zilong Huang, Man-Wai Mak

On the influence of language similarity in non-target speaker verification trials

Paul M. Reuter, Michael Jessen

Variability in performance across four generations of automatic speaker recognition systems

Lauren Harrington, Vincent Hughes, Philip Harrison, Paul Foulkes, Jessica Wormald

Vo-Ve: An Explainable Voice-Vector for Speaker Identity Evaluation

Jaejun Lee, Kyogu Lee

STCON NIST SRE24 System: Composite Speaker Recognition Solution for Challenging Scenarios

Stepan Malykh, Alexander Anikin, Nikita Khmelev, Anastasia Korenevskaya, Anastasia Zorkina

Analysis of the ABC Classification Backends for NIST SRE24

Sandro Cumani, Anna Silnova, Sara Barahona, Ladislav Mošner, Oldřich Plchot

Leveraging Large Language Models for Sarcastic Speech Annotation in Sarcasm Detection

Zhu Li, Yuqing Zhang, Xiyuan Gao, Shekhar Nayak, Matt Coler

A Multimodal Chinese Dataset for Cross-lingual Sarcasm Detection

Xiyuan Gao, Bruce Xiao Wang, Meiling Zhang, Shuming Huang, Zhu Li

Scalable Spontaneous Speech Dataset (SSSD): Crowdsourcing Data Collection to Promote Dialogue Research

Zaid Sheikh, Shuichiro Shimizu, Siddhant Arora, Jiatong Shi, Samuele Cornell

Investigating Affect Mining Techniques for Annotation Sample Selection in the Creation of Finnish Affective Speech Corpus

Kalle Lahtinen, Einari Vaaras, Liisa Mustanoja, Okko Rasanen

Contextual Paralinguistic Data Creation for Multi-Modal Speech-LLM: Data Condensation and Spoken QA Generation

Qiongqiong Wang, Hardik B. Sailor, TIANCHI LIU, Ai Ti Aw

Fifteen Years of Child-Centered Long-Form Recordings: Promises, Resources, and Remaining Challenges to Validity

Loann Peurey, Marvin Lavechin, Tarek Kunze, Manel Khentout, Lucas Gautheron

Challenges and practical guidelines for atypical speech data collection, annotation, usage and sharing: A multi-project perspective

Zhengjun Yue, Mara Barberis, Tanvina Patel, Judith Dineley, Willemijn Doedens

The Speech Accessibility Project: Best Practices for Collection and Curation of Disordered Speech

Chris Zwilling, Mark Hasegawa-Johnson, Heather Hodges, Lorraine Ramig, Adina Bradshaw

Quantifying and Reducing Speaker Heterogeneity within the Common Voice Corpus for Phonetic Analysis

Miao Zhang, Aref Farhadipour, Annie Baker, Jiachen Ma, Bogdan Pricop

Collecting, Curating, and Annotating Good Quality Speech deepfake dataset for Famous Figures: Process and Challenges

Hashim Ali, Surya Subramani, Raksha Varahamurthy, Nithin Adupa, Lekha Bollinani

Granary: Speech Recognition and Translation Dataset in 25 European Languages

Nithin Rao Koluguri, Monica Sekoyan, George Zelenfroynd, Sasha Meister, Shuoyang Ding

CommissionsQC: a Québec French Speech Corpus for Automatic Speech Recognition

Coralie Serrand, Amira Morsli, Gilles Boulianne

J-SPAW: Japanese speaker verification and spoofing attacks recorded in-the-wild dataset

Sayaka Shiota, Suzuka Horie, Kouta Kanno, Shinnosuke Takamichi

VCapAV: A Video-Caption Based Audio-Visual Deepfake Detection Dataset

Yuxi Wang, Yikang Wang, Qishan Zhang, Hiromitsu Nishizaki, Ming Li

A Study of Real-world Audio-Visual Corpus Design and Production: A Perspective from MISP Challenges

Hang Chen, Jun Du, Qing Wang, Juan Xie, Shi-Fu XIong

Thinking in Directivity: Speech Large Language Model for Multi-Talker Directional Speech Recognition

Jiamin Xie, Ju Lin, Yiteng Huang, Tyler Vuong, Zhaojiang Lin

SOMSRED-SVC: Sequential Output Modeling with Speaker Vector Constraints for Joint Multi-Talker Overlapped ASR and Speaker Diarization

Naoki Makishima, Naotaka Kawata, Taiga Yamane, Mana Ihori, Tomohiro Tanaka

Improving Synthetic Data Training for Contextual Biasing Models with a Keyword-Aware Cost Function

Chin Yuen Kwok, Jia Qi Yip, Eng Siong Chng

Automatic Speech Recognition of African American English: Lexical and Contextual Effects

Hamid Mojarad, Kevin Tang

FairASR: Fair Audio Contrastive Learning for Automatic Speech Recognition

Jongsuk Kim, Jaemyung Yu, Minchan Kwon, Junmo Kim

PredTrAD – Prediction-based Transformer for Anomaly Detection in Multivariate Time Series Data

Jan Schuster, Alexander Wölfel, Fabian Brunner, Christian Bergler

REB-former: RWKV-enhanced E-branchformer for Speech Recognition

Jie Song, Wang Xiang, Jian Zhou, Cunhang Fan, Zhao Lv

MSDA: Combining Pseudo-labeling and Self-Supervision for Unsupervised Domain Adaptation in ASR

Dimitrios Damianos, Georgios Paraskevopoulos, Alexandros Potamianos

Distilling a speech and music encoder with task arithmetic

Fabian Ritter-Gutierrez, Yi-Cheng Lin, Jui-Chiang Wei, Jeremy H.M Wong, Eng Siong Chng

A Robust Hybrid ACC-PM Approach for Personal Sound Zones

Yaqi Zhu, Lei Zhou, Hongqing Liu, Liming Shi, Lu Gan

First Analyze Then Enhance: A Task-Aware System for Speech Separation, Denoising, and Dereverberation

Shaoxiang Dang, Li Li, Shogo Seki, Hiroaki Kudo

Individualized speech enhancement for hearing-impaired listeners

Chuan Wen, Sarah Verhulst

Joint Rate Allocation and Sensor Selection for Speech Enhancement in Wireless Acoustic Sensor Networks

De Hu, Qilong Li

Modality-Specific Speech Enhancement and Noise-Adaptive Fusion for Acoustic and Body-Conduction Microphone Framework

Yunsik Kim, Yoonyoung Chung

SpeechRefiner: Towards Perceptual Quality Refinement for Front-End Algorithms

Sirui Li, Shuai Wang, Zhijun Liu, Zhongjie Jiang, Yannan Wang