Interspeech 2025

1,179 papers

Improving Child Speech Recognition and Reading Mistake Detection by Using Prompts

Lingyun Gao, Cristian Tejedor-García, Catia Cucchiarini, Helmer Strik

Challenges in Automated Processing of Speech from Child Wearables: The Case of Voice Type Classifier

Tarek Kunze, Marianne Métais, Hadrien Titeux, Lucas Elbert, Joseph Coffey

Large Language Models based ASR Error Correction for Child Conversations

Anfeng Xu, Tiantian Feng, So Hyun Kim, Somer Bishop, Catherine Lord

Egocentric Speaker Classification in Child-Adult Dyadic Interactions: From Sensing to Computational Modeling

Tiantian Feng, Anfeng Xu, Xuan Shi, Somer Bishop, Shrikanth Narayanan

On Enhancing the Performance of Children's ASR Task in Limited Data Scenario

Ankita Ankita, Shambhavi Shambhavi, Syed Shahnawazuddin

Employing self-supervised learning models for cross-linguistic child speech maturity classification

Theo Zhang, Madurya Suresh, Anne Warluamont, Kasia Hitczenko, Alejandrina Cristia

Examining Test-Time Adaptation for Personalized Child Speech Recognition

Zhonghao Shi, Xuan Shi, Anfeng Xu, Tiantian Feng, Harshvardhan Srivastava

FT-Boosted SV: Towards Noise Robust Speaker Verification for English Speaking Classroom Environments

Saba Tabatabaee, Jing Liu, Carol Espy-Wilson

Children's Voice Privacy: First Steps and Emerging Challenges

Ajinkya Kulkarni, Francisco Teixeira, Enno Hermann, Thomas Rolland, Isabel Trancoso

PERCEPT-US: A Multimodal American English Child Speech Corpus Specialized for Articulatory Feedback

Amanda Eads, Heather Kabakoff, Nina Benway, Elaine Hitchcock, Jonathan Preston

Subtyping Speech Errors in Childhood Speech Sound Disorders with Acoustic-to-Articulatory Speech Inversion

Nina R Benway, Saba Tabatabaee, Benjamin Munson, Jonathan Preston, Carol Espy-Wilson

Band-Split Self-supervised Mamba for Infant-centered Audio Analysis

Xulin Fan, Jialu Li, Mark Hasegawa-Johnson, Nancy L. McElwain

Voice Conversion Improves Cross-Domain Robustness for Spoken Arabic Dialect Identification

Badr M. Abdullah, Matthew Baas, Bernd Möbius, Dietrich Klakow

Effects of Prosodic Information on Dialect Classification Using Whisper Features

Phoebe Parsons, Heming Strømholt Bremnes, Knut Kvale, Torbjørn Svendsen, Giampiero Salvi

Improving Low-Resource Dialect Classification Using Retrieval-based Voice Conversion

Lea Fischbach, Akbar Karimi, Caroline Kleen, Alfred Lameli, Lucie Flek

ADI-20: Arabic Dialect Identification dataset and models

Haroun Elleuch, Salima Mdhaffar, Yannick Estève, Fethi Bougares

Jointly Improving Dialect Identification and ASR in Indian Languages using Multimodal Feature Fusion

Saurabh Kumar, Amartyaveer, Prasanta Kumar Ghosh

Audio-Based Classification and Geographic Regression of Austrian Dialects

Lorenz Gutscher, Michael Pucher

Unsupervised Rhythm and Voice Conversion to Improve ASR on Dysarthric Speech

Karl El Hajal, Enno Hermann, Sevada Hovsepyan, Mathew Magimai Doss

Synthetic Dysarthric Speech: A Supplement, Not a Substitute for Authentic Data in Dysarthric Speech Recognition

Jingting Li, Keyi Feng, Xinran Zhao, Yan Wang, Su-Jing Wang

Fairness in Dysarthric Speech Synthesis: Understanding Intrinsic Bias in Dysarthric Speech Cloning using F5-TTS

Anuprabha M, Krishna Gurugubelli, Anil Kumar Vuppala

Data Augmentation using Speech Synthesis for Speaker-Independent Dysarthria Severity Classification

Minseop Kim, Minsu Han, Seokyoung Hong, Myoung-Wan Koo

Objective and Subjective Evaluation of Diffusion-Based Speech Enhancement for Dysarthric Speech

Dimme de Groot, Tanvina Patel, Devendra Kayande, Odette Scharenborg, Zhengjun Yue

Voice Reconstruction through Large-Scale TTS Models: Comparing Zero-Shot and Fine-tuning Approaches to Personalise TTS in Assistive Communication

Eva Szekely, Peter Mihajlik, Máté Soma Kádár, László Tóth

The role of audio-visual integration in the time course of phonetic encoding in self-supervised speech models

Yi Wang, Oli Danyi Liu, Peter Bell

Enhanced Hybrid Transducer and Attention Encoder Decoder with Text Data

Yun Tang, Eesung Kim, Vijendra Raj Apsingekar

U-SAM: An Audio Language Model for Unified Speech, Audio, and Music Understanding

Ziqian Wang, Xianjun Xia, Xinfa Zhu, Lei Xie

Efficient and Direct Duplex Modeling for Speech-to-Speech Language Model

Ke Hu, Ehsan Hosseini-Asl, Chen Chen, Edresson Casanova, Subhankar Ghosh

PAEFF: Precise Alignment and Enhanced Gated Feature Fusion for Face-Voice Association

Abdul Hannan, Muhammad Arslan Manzoor, Shah Nawaz, Muhammad Irzam Liaqat, Markus Schedl

CNVSRC 2024: The Second Chinese Continuous Visual Speech Recognition Challenge

Zehua Liu, Xiaolou Li, Chen Chen, Lantian Li, Dong Wang

SNIFR : Boosting Fine-Grained Child Harmful Content Detection Through Audio-Visual Alignment with Cascaded Cross-Transformer

Orchid Chetia Phukan, Mohd Mujtaba Akhtar, Girish, Swarup Ranjan Behera, Abu Osama Siddiqui

GIA-MIC: Multimodal Emotion Recognition with Gated Interactive Attention and Modality-Invariant Learning Constraints

Jiajun He, Jinyi Mi, Tomoki Toda

CAMER: Contribution-Aware Multimodal Emotion Recognition

Sun-Kyung Lee, Jong-Hwan Kim

SpokenNativQA: Multilingual Everyday Spoken Queries for LLMs

Firoj Alam, Md Arid Hasan, Shammur Absar Chowdhury

GraphemeAug: A Systematic Approach to Synthesized Hard Negative Keyword Spotting Examples

Harry Zhang, Kurt Partridge, Pai Zhu, Neng Chen, Hyun Jin Park

LLM-Synth4KWS: Scalable Automatic Generation and Synthesis of Confusable Data for Custom Keyword Spotting

Pai Zhu, Quan Wang, Dhruuv Agarwal, Kurt Partridge

Multichannel Keyword Spotting for Noisy Conditions

Dzmitry Saladukha, Ivan Koriabkin, Kanstantsin Artsiom, Aliaksei Rak, Nikita Ryzhikov

SIDC-KWS: Efficient Spiking Inception-Dilated Conformer with Self-Attention for Keyword Spotting

Jin Gyo Lim, Seong Eun Kim

On Retrieval of Long Audios with Complex Text Queries

Ruochu Yang, Milind Rao, Harshavardhan Sundar, Anirudh Raju, Aparna Khare

Enhancing Retrieval-Augmented Audio Captioning with Generation-Assisted Multimodal Querying and Progressive Learning

Changin Choi, Sungjun Lim, Wonjong Rhee

GTA: Towards Generative Text-To-Audio Retrieval via Multi-Scale Tokenizer

Minghui Fang, Shengpeng Ji, Jialong Zuo, Xize Cheng, Wenrui Liu

Adversarial Deep Metric Learning for Cross-Modal Audio-Text Alignment in Open-Vocabulary Keyword Spotting

Youngmoon Jung, Yong-Hyeok Lee, Myunghun Jung, Jaeyoung Roh, Chang Woo Han

Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval

Ruofan Hu, Yan Xia, Minjie Hong, jieming zhu, Bo Chen

H-QuEST: Accelerating Query-by-Example Spoken Term Detection with Hierarchical Indexing

Akanksha Singh, Yi-Ping Phoebe Chen, Vipul Arora

Language-Agnostic Speech Tokenizer for Spoken Term Detection with Efficient Retrieval

Anup Singh, Kris Demuynck, Vipul Arora

An Effective Anomalous Sound Detection Method Based on Global and Local Attribute Mining

Nan Jiang, Yan Song, Qing Gu, Haoyu Song, Lirong Dai

Anomalous Sound Detection Based Feature Fusion and Dual-path Non-linear Independent Components Estimation

Yawei Wang, Qiaoling Zhang, Yi Zhang, Junyao Hu

AC/DC: LLM-based Audio Comprehension via Dialogue Continuation

Yusuke Fujita, Tomoya Mizumoto, Atsushi Kojima, Lianbo Liu, Yui Sudo

Language-Guided Contrastive Audio-Visual Masked Autoencoder with Automatically Generated Audio-Visual-Text Triplets from Videos

Yuchi Ishikawa, Shota Nakada, Hokuto Munakata, Kazuhiro Saito, Tatsuya Komatsu

Leveraging Unlabeled Audio for Audio-Text Contrastive Learning via Audio-Composed Text Features

Tatsuya Komatsu, Hokuto Munakata, Yuchi Ishikawa

Leveraging Multi-Level Features of ATST with Conformer-Based Dual-Branch Network for Sound Event Detection

Lipeng Dai, Qing Wang, Jie Zhang, Shengyu Peng, Yu Guan

Zero-Shot Learning for Acoustic Event Classification Using an Attribute Vector and Conditional GAN

Kohei Uehara, Ryoichi Takashima, Tetsuya Takiguchi

Improving Audio Classification by Transitioning from Zero- to Few-Shot

James Taylor, Wolfgang Mack

Selective Invocation for Multilingual ASR: A Cost-effective Approach Adapting to Speech Recognition Difficulty

Hongfei Xue, Yufeng Tang, Jun Zhang, Xuelong Geng, Lei Xie

CMT-LLM: Contextual Multi-Talker ASR Utilizing Large Language Models

Jiajun He, Naoki Sawada, Koichi Miyazaki, Tomoki Toda

Directional Speech Recognition with Full-Duplex Capability

Ju Lin, Yiteng Huang, Ming Sun, Frank Seide, Florian Metze

Word Level Timestamp Generation for Automatic Speech Recognition and Translation

Ke Hu, Krishna Puvvada, Elena Rastorgueva, Zhehuai Chen, He Huang

Running Conventional Automatic Speech Recognition on Memristor Hardware: A Simulated Approach

Nick Rossenbach, Benedikt Hilmes, Leon Brackmann, Moritz Gunz, Ralf Schlüter

Assessment of the synthetic quality and controllability of laughing onset in speech-laugh synthesis

Ryo Setoguchi, Yoshiko Arimoto

When The MOS Predictor Asks For Training Annotation In Cross Lingual/Domain Adaptation

Natacha Miniconi, Meysam Shamsi, Anthony Larcher

Enabling the replicability of speech synthesis perceptual evaluations

Sébastien Le Maguer, Gwénolé Lecorvé, Damien Lolive, Naomi Harte, Juraj Simko

Transcript-Prompted Whisper with Dictionary-Enhanced Decoding for Japanese Speech Annotation

Rui Hu, Xiaolong Lin, Jiawang Liu, Shixi Huang, Zhenpeng Zhan

Speech-guided Grapheme-to-Phoneme Conversion for Cantonese Text-to-Speech

Timothy Shin Heng Mak, King Yiu Suen, Albert Y.S. Lam

Non-Standard Accent TTS Support via Large Multi-Accent Frontend Pronunciation Knowledge Transfer

Noe Berger, Siqi Sun, Korin Richmond

Grapheme-Coherent Phonemic and Prosodic Annotation of Speech by Implicit and Explicit Grapheme Conditioning

Hien Ohnaka, Yuma Shirahata, Byeongseon Park, Ryuichi Yamamoto

SonarGuard2: Ultrasonic Face Liveness Detection Based on Adaptive Doppler Effect Feature Extraction

Xiaoming Zhang, Ke-Yue Zhang, Taiping Yao, Songjun Cao, Shouhong Ding

Deep learning based spatial aliasing reduction in beamforming for audio capture

Mateusz Guzik, Giulio Cengarle, Daniel Arteaga

D-GAT: Dual Graph Attention Network for Global HRTF Interpolation

Junsheng Hu, Shaojie Li, Qintuya Si, De Hu

Direct-path Relative Harmonic Coefficients Detection for Multi-source Direction-of-Arrival Estimation in Reverberant Environments

Liang Tao, Maoshen Jia, Yonggang Hu

Joint Reference Microphone Selection and Filter Order Determination in Multi-channel Active Noise Control

De Hu, Shuyao Liu, Yanrong He

Efficient and Microphone-Fault-Tolerant 3D Sound Source Localization

Yiyuan Yang, Shitong Xu, Niki Trigoni, Andrew Markham

Spatially Weighted Contrastive Learning for Robust Sound Source Localization

Hyun-Soo Kim, Da-Hee Yang, Joon-Hyuk Chang

TA-RIR: Topology-Aware Neural Modeling of Acoustic Propagation for Room Impulse Response Synthesis

Junhui Zhao, Hang Chen, Qing Wang, Jun Du, Yanhui Tu

SepVAC: Multitask Learning of Speaker Separation, Speaker Localization, Microphone Array Localization, and Room Acoustic Parameter Estimation in Various Acoustic Conditions

Roland Hartanto, Sakriani Sakti, Koichi Shinoda

Robust Neural Codec Language Modeling with Phoneme Position Prediction for Zero-Shot TTS

Chunhui Lu, Xue Wen, Liming Song, Junkwang Oh

Bridging the Training–Inference Gap in TTS: Training Strategies for Robust Generative Postprocessing for Low-Resource Speakers

Frank Zalkow, Paolo Sani, Kishor Kayyar Lakshminarayana, Emanuël A. P. Habets, Nicola Pia

Improving Noise Robustness of LLM-based Zero-shot TTS via Discrete Acoustic Token Denoising

Ye-Xin Lu, Hui-Peng Du, Fei Liu, Yang Ai, Zhen-Hua Ling

Monotonic Attention for Robust Text-to-Speech Synthesis in Large Language Model Frameworks

Yike Zhang, Yiming Li, Jie Chen, Qinghua Wu, Songjun Cao

Long-Context Speech Synthesis with Context-Aware Memory

Zhipeng Li, Xiaofen Xing, Jingyuan Xing, Hangrui Hu, Heng Lu

Differentiable Reward Optimization for LLM based TTS system

Changfeng Gao, Zhihao Du, Shiliang Zhang

Accelerating Flow-Matching-Based Text-to-Speech via Empirically Pruned Step Sampling

Qixi Zheng, Yushen Chen, Zhikang Niu, Ziyang Ma, Xiaofei Wang

RapFlow-TTS: Rapid and High-Fidelity Text-to-Speech with Improved Consistency Flow Matching

Hyun Joon Park, Jeongmin Liu, Jin Sob Kim, Jeong Yeol Yang, Sung Won Han

Mispronunciation Detection Without L2 Pronunciation Dataset in Low-Resource Setting: A Case Study in Finland Swedish

Nhan Phan, Mikko Kuronen, Maria Kautonen, Riikka Ullakonoja, Anna von Zansen

Enhancing Generalization of Speech Large Language Models with Multi-Task Behavior Imitation and Speech-Text Interleaving

Jingran Xie, Xiang Li, Hui Wang, Yue Yu, Yang Xiang

Multimodal and Multitask Learning for Predicting Multiple Scores in L2 English Speech

Sehyun Oh, Sunhee Kim, Minhwa Chung

A Perception-Based L2 Speech Intelligibility Indicator: Leveraging a Rater’s Shadowing and Sequence-to-sequence Voice Conversion

Haopeng Geng, Daisuke Saito, Nobuaki Minematsu

OMPAL: Bridging Speech and Learning with an Open-Source Mandarin Pronunciation Assessment Corpus for Global Learners

Wen-Wei Hsieh, Hao-Wei Chi, Kuan-Chen Wang, Ping-Cheng Yeh, Te-hsin Liu

Towards a Unified Benchmark for Arabic Pronunciation Assessment: Qur’anic Recitation as Case Study

Yassine El Kheir, Omnia Ibrahim, Amit Meghanani, Nada Almarwani, Hawau Toyin

Evaluating Logit-Based GOP Scores for Mispronunciation Detection

Aditya Kamlesh Parikh, Cristian Tejedor-García, Catia Cucchiarini, Helmer Strik

SGED-Probe: Probing E2E ASR decoder and aligner for spoken grammar error detection under three speaking practice conditions

Chowdam Venkata Thirumala Kumar, Chiranjeevi Yarra

Can ASR generate valid measures of child reading fluency?

Wieke Harmsen, Roeland van Hout, Catia Cucchiarini, Helmer Strik

Automatic Dialectal Transcription: An Evaluation on Finnish and Norwegian

Olli Kuparinen

Exploiting Bispectral Features for Single-Channel Speech Enhancement

Venkatesh Parvathala, Ramesh Gundluru, Sreekanth Sankala, K. Sri Rama Murty

Few-step Adversarial Schrödinger Bridge for Generative Speech Enhancement

Seungu Han, Sungho Lee, Juheon Lee, Kyogu Lee

Test-Time Training for Speech Enhancement

Avishkar Behera, Riya Ann Easow, Venkatesh Parvathala, K. Sri Rama Murty

Model as Loss: A Self-Consistent Training Paradigm

Saisamarth Rajesh Phaye, Milos Cernak, Andrew Harper

Dynamic Layer Gating for Speech Enhancement

Venkatesh Parvathala, K. Sri Rama Murty

Investigating continuous autoregressive generative speech enhancement

Haici Yang, Gordon Wichern, Ryo Aihara, Yoshiki Masuyama, Sameer Khurana

SHEET: A Multi-purpose Open-source Speech Human Evaluation Estimation Toolkit

Wen-Chin Huang, Erica Cooper, Tomoki Toda

FUSE-MOS: Fusion of Speech Embeddings for MOS Prediction with Uncertainty Quantification

Enjamamul Hoq, Nikhil Gupta, Danielle Omondi, Ifeoma Nwogu