Skip to content
conftrace_

Interspeech 2024

1,065 papers

Unmasking Neural Codecs: Forensic Identification of AI-compressed Speech

Denise Moussa, Sandra Bergmann, Christian Riess

HarmoNet: Partial DeepFake Detection Network based on Multi-scale HarmoF0 Feature Fusion

Liwei Liu, Huihui Wei, Dongya Liu, Zhonghua Fu

TraceableSpeech: Towards Proactively Traceable Text-to-Speech with Watermarking

Junzuo Zhou, Jiangyan Yi, Tao Wang, Jianhua Tao, Ye Bai

A New Approach to Voice Authenticity

Nicolas M. Müller, Piotr Kawa, Shen Hu, Matthias Neu, Jennifer Williams

Frequency-mix Knowledge Distillation for Fake Speech Detection

Cunhang Fan, Shunbo Dong, Jun Xue, yujie Chen, Jiangyan Yi

SilentCipher: Deep Audio Watermarking

Mayank Kumar Singh, Naoya Takahashi, Weihsiang Liao, Yuki Mitsufuji

Privacy PORCUPINE: Anonymization of Speaker Attributes Using Occurrence Normalization for Space-Filling Vector Quantization

Mohammad Hassan Vali, Tom Bäckström

Noise-aware Speech Enhancement using Diffusion Probabilistic Model

Yuchen Hu, Chen Chen, Ruizhe Li, Qiushi Zhu, Eng Siong Chng

Complex Image-Generative Diffusion Transformer for Audio Denoising

Junhui Li, Pu Wang, Jialu Li, Youshan Zhang

RT-LA-VocE: Real-Time Low-SNR Audio-Visual Speech Enhancement

Honglie Chen, Rodrigo Mira, Stavros Petridis, Maja Pantic

FlowAVSE: Efficient Audio-Visual Speech Enhancement with Conditional Flow Matching

Chaeyoung Jung, Suyeon Lee, Ji-Hoon Kim, Joon Son Chung

An Analysis of the Variance of Diffusion-based Speech Enhancement

Bunlong Lay, Timo Gerkmann

Diffusion Gaussian Mixture Audio Denoise

Pu Wang, Junhui Li, Jialu Li, Liangdong Guo, Youshan Zhang

Locally Aligned Rectified Flow Model for Speech Enhancement Towards Single-Step Diffusion

Zhengxiao Li, Nakamasa Inoue

Towards Audio Codec-based Speech Separation

Jia Qi Yip, Shengkui Zhao, Dianwen Ng, Eng Siong Chng, Bin Ma

Enhanced Deep Speech Separation in Clustered Ad Hoc Distributed Microphone Environments

Jihyun Kim, Stijn Kindt, Nilesh Madhu, Hong-Goo Kang

Improving Generalization of Speech Separation in Real-World Scenarios: Strategies in Simulation, Optimization, and Evaluation

Ke Chen, Jiaqi Su, Taylor Berg-Kirkpatrick, Shlomo Dubnov, Zeyu Jin

Unsupervised Improved MVDR Beamforming for Sound Enhancement

Jacob Kealey, John R. Hershey, François Grondin

MSDET: Multitask Speaker Separation and Direction-of-Arrival Estimation Training

Roland Hartanto, Sakriani Sakti, Koichi Shinoda

Noise-robust Speech Separation with Fast Generative Correction

Helin Wang, Jesus Villalba, Laureano Moro-Velazquez, Jiarui Hai, Thomas Thebaud

A Comprehensive Investigation on Speaker Augmentation for Speaker Recognition

Zhenyu Zhou, Shibiao Xu, Shi Yin, Lantian Li, Dong Wang

Evaluating the Santa Barbara Corpus: Challenges of the Breadth of Conversational Spoken Language

Matthew Maciejewski, Dominik Klement, Ruizhe Huang, Matthew Wiesner, Sanjeev Khudanpur

DB-PMAE: Dual-Branch Prototypical Masked AutoEncoder with locality for domain robust speaker verification

Wei-lin Xie, Yu-Xuan Xi, Yan Song, Jian-tao Zhang, Hao-yu Song

SE/BN Adapter: Parametric Efficient Domain Adaptation for Speaker Recognition

Tianhao Wang, Lantian Li, Dong Wang

Efficient Integrated Features Based on Pre-trained Models for Speaker Verification

Yishuang Li, Wenhao Guan, Hukai Huang, Shiyu Miao, Qi Su

Multi-Channel Extension of Pre-trained Models for Speaker Verification

Ladislav Mošner, Romain Serizel, Lukas Burget, Oldřich Plchot, Emmanuel Vincent

Disentangled Representation Learning for Environment-agnostic Speaker Recognition

Kihyun Nam, Hee-soo Heo, Jee-weon Jung, Joonson Chung

MR-RawNet: Speaker verification system with multiple temporal resolutions for variable duration utterances using raw waveforms

Seung-Bin Kim, Chan-yeong Lim, Jungwoo Heo, Ju-ho Kim, Hyun-seo Shin

Enhancing ECAPA-TDNN with Feature Processing Module and Attention Mechanism for Speaker Verification

Shiu-Hsiang Liou, Po-Cheng Chan, Chia-Ping Chen, Tzu-Chieh Lin, Chung-Li Lu

Speaker Conditional Sinc-Extractor for Personal VAD

En-Lun Yu, Kuan-Hsun Ho, Jeih-Weih Hung, Shih-Chieh Huang, Berlin Chen

Fine-tune Pre-Trained Models with Multi-Level Feature Fusion for Speaker Verification

Shengyu Peng, Wu Guo, Haochen Wu, Zuoliang Li, Jie Zhang

Balance, Multiple Augmentation, and Re-synthesis: A Triad Training Strategy for Enhanced Audio Deepfake Detection

Thien-Phuc Doan, Long Nguyen-Vu, Kihun Hong, Souhwan Jung

Speech Formants Integration for Generalized Detection of Synthetic Speech Spoofing Attacks

Kexu Liu, Yuanxin Wang, Shengchen Li, Xi Shao

Adapter Learning from Pre-trained Model for Robust Spoof Speech Detection

Haochen Wu, Wu Guo, Shengyu Peng, Zhuhai Li, Jie Zhang

Attentive Merging of Hidden Embeddings from Pre-trained Speech Model for Anti-spoofing Detection

Zihan Pan, TIANCHI LIU, Hardik B. Sailor, Qiongqiong Wang

Exploring Self-supervised Embeddings and Synthetic Data Augmentation for Robust Audio Deepfake Detection

Juan M. Martín-Doñas, Aitor Álvarez, Eros Rosello, Angel M. Gomez, Antonio M. Peinado

Spoofed Speech Detection with a Focus on Speaker Embedding

Hoan My Tran, David Guennec, Philippe Martin, Aghilas Sini, Damien Lolive

Urdu Alternative Questions: A Hat Pattern

Benazir Mumtaz, Miriam Butt

Influences of Morphosyntax and Semantics on the Intonation of Mandarin Chinese Wh-indeterminates

Hongchen Wu, Jiwon Yun

The prosody of the verbal prefix ge-: historical and experimental evidence

Chiara Riegger, Tina Bögel, George Walkden

On Comparing Time- and Frequency-Domain Rhythm Measures in Classifying Assamese Dialects

Joyshree Chakraborty, Leena Dihingia, Priyankoo Sarmah, Rohit Sinha

Form and Function in Prosodic Representation: In the Case of 'ma' in Tianjin Mandarin

Tianqi Geng, Hui Feng

Automatic pitch accent classification through image classification

Na Hu, Hugo Schnack, Amalia Arvaniti

TEEMI: a speaking practice tool for L2 English learners

Szu-Yu Chen, Tien-Hong Lo, Yao-Ting Sung, Ching-Yu Tseng, Berlin Chen

Real-time scheme for rapid extraction of speaker embeddings in challenging recording conditions

Kai Liu, Ziqing Du, Zhou Huan, Xucheng Wan, Naijun Zheng

Pragmatically similar utterance finder demonstration

Nigel G. Ward, Andres Segura

A demonstrator for articulation-based command word recognition

João Vítor Possamai de Menezes, Arne-Lukas Fietkau, Tom Diener, Steffen Kürbis, Peter Birkholz

Understanding “understanding”: presenting a richly annotated multimodal corpus of dyadic interaction

Leonie Schade, Nico Dallmann, Olcay Tük, Stefan Lazarov, Petra Wagner

Leveraging large language models for post-transcription correction in contact centers

Bramhendra Koilakuntla, Prajesh Rana, Paras Ahuja, Srikanth Konjeti, Jithendra Vepa

Detection of background agents speech in contact centers

Abhishek Kumar, Srikanth Konjeti, Jithendra Vepa

Real-Time Gaze-directed speech enhancement for audio-visual hearing-aids

Arif Reza Anway, Bryony Buck, Mandar Gogate, Kia Dashtipour, Michael Akeroyd

Edged based audio-visual speech enhancement demonstrator

Song Chen, Mandar Gogate, Kia Dashtipour, Jasper Kirton-Wingate, Adeel Hussain

Custom wake word detection

Kesavaraj V, Charan Devarkonda, Vamshiraghusimha Narasinga, Anil Kumar Vuppala

Perceiver-Prompt: Flexible Speaker Adaptation in Whisper for Chinese Disordered Speech Recognition

Yicong Jiang, Tianzi Wang, Xurong Xie, Juan Liu, Wei Sun

Zero-Shot End-To-End Spoken Question Answering In Medical Domain

Yanis Labrak, Adel Moumen, Richard Dufour, Mickael Rouvier

Variability of speech timing features across repeated recordings: a comparison of open-source extraction techniques

Judith Dineley, Ewan Carr, Lauren L. White, Catriona Lucas, Zahia Rahman

“So . . . my child . . . ” – How Child ADHD Influences the Way Parents Talk

Anika A. Spiesberger, Andreas Triantafyllopoulos, Alexander Kathan, Anastasia Semertzidou, Caterina Gawrilow

How Consistent are Speech-Based Biomarkers in Remote Tracking of ALS Disease Progression Across Languages? A Case Study of English and Dutch

Hardik Kothare, Michael Neumann, Cathy Zhang, Jackson Liscombe, Jordi W J van Unnik

Automatic Prediction of Amyotrophic Lateral Sclerosis Progression using Longitudinal Speech Transformer

Liming Wang, Yuan Gong, Nauman Dawalatabad, Marco Vilela, Katerina Placek

When Whisper Listens to Aphasia: Advancing Robust Post-Stroke Speech Recognition

Giulia Sanguedolce, Sophie Brook, Dragos C. Gruia, Patrick A. Naylor, Fatemeh Geranmayeh

Automatic recognition and detection of aphasic natural speech

Mara Barberis, Pieter De Clercq, Bastiaan Tamm, Hugo Van hamme, Maaike Vandermosten

Towards Scalable Remote Assessment of Mild Cognitive Impairment Via Multimodal Dialog

Oliver Roesler, Jackson Liscombe, Michael Neumann, Hardik Kothare, Abhishek Hosamath

Infusing Acoustic Pause Context into Text-Based Dementia Assessment

Franziska Braun, Sebastian P. Bayerl, Florian Hönig, Hartmut Lehfeld, Thomas Hillemacher

Macro-descriptors for Alzheimer's disease detection using large language models

Catarina Botelho, John Mendonça, Anna Pompili, Tanja Schultz, Alberto Abad

Towards objective and interpretable speech disorder assessment: a comparative analysis of CNN and transformer-based models

Malo Maisonneuve, Corinne Fredouille, Muriel Lalain, Alain Ghio, Virginie Woisard

It’s Time to Take Action: Acoustic Modeling of Motor Verbs to Detect Parkinson’s Disease

Daniel Escobar-Grisales, Cristian David Rios-Urrego, Ilja Baumann, Korbinian Riedhammer, Elmar Noeth

Real-time Speech Summarization for Medical Conversations

Khai Le-Duc, Khai-Nguyen Nguyen, Long Vo-Dang, Truong-Son Hy

Prompting Large Language Models with Audio for General-Purpose Speech Summarization

Wonjune Kang, Deb Roy

An End-to-End Speech Summarization Using Large Language Model

Hengchao Shang, Zongyao Li, Jiaxin Guo, Shaojun Li, Zhiqiang Rao

Sentence-wise Speech Summarization: Task, Datasets, and End-to-End Modeling with LM Knowledge Distillation

Kohei Matsuura, Takanori Ashihara, Takafumi Moriya, Masato Mimura, Takatomo Kano

Key-Element-Informed sLLM Tuning for Document Summarization

Sangwon Ryu, Heejin Do, Yunsu Kim, Gary Geunbae Lee, Jungseul Ok

Optimizing the role of human evaluation in LLM-based spoken document summarization systems

Margaret Kroll, Kelsey Kraus

CNVSRC 2023: The First Chinese Continuous Visual Speech Recognition Challenge

Chen Chen, Zehua Liu, Xiaolou Li, Lantian Li, Dong Wang

Joint Speaker Features Learning for Audio-visual Multichannel Speech Separation and Recognition

Guinan Li, Jiajun Deng, Youjun Chen, Mengzhe Geng, Shujie Hu

LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition

Sreyan Ghosh, Sonal Kumar, Ashish Seth, Purva Chiniya, Utkarsh Tyagi

AVCap: Leveraging Audio-Visual Features as Text Tokens for Captioning

Jongsuk Kim, Jiwon Shin, Junmo Kim

Pinyin Regularization in Error Correction for Chinese Speech Recognition with Large Language Models

Zhiyuan Tang, Dong Wang, Shen Huang, Shidong Shang

A Transcription Prompt-based Efficient Audio Large Language Model for Robust Speech Recognition

Yangze Li, Xiong Wang, Songjun Cao, Yike Zhang, Long Ma

Speech ReaLLM – Real-time Speech Recognition with Multimodal Language Models by Teaching the Flow of Time

Frank Seide, Yangyang Shi, Morrie Doulaty, Yashesh Gaur, Junteng Jia

Speech Prefix-Tuning with RNNT Loss for Improving LLM Predictions

Murali Karthick Baskar, Andrew Rosenberg, Bhuvana Ramabhadran, Neeraj Gaur, Zhong Meng

An End-to-End Approach for Chord-Conditioned Song Generation

Shuochen Gao, Shun Lei, Fan Zhuo, Hangyu Liu, Feng Liu

X-Singer: Code-Mixed Singing Voice Synthesis via Cross-Lingual Learning

Ji-Sang Hwang, HyeongRae Noh, Yoonseok Hong, Insoo Oh

Singing Voice Data Scaling-up: An Introduction to ACE-Opencpop and ACE-KiSing

Jiatong Shi, Yueqian Lin, Xinyi Bai, Keyi Zhang, Yuning Wu

Period Singer: Integrating Periodic and Aperiodic Variational Autoencoders for Natural-Sounding End-to-End Singing Voice Synthesis

Taewoo Kim, Choonsang Cho, Young Han Lee

Challenge of Singing Voice Synthesis Using Only Text-To-Speech Corpus With FIRNet Source-Filter Neural Vocoder

Takuma Okamoto, Yamato Ohtani, Sota Shimizu, Tomoki Toda, Hisashi Kawai

MakeSinger: A Semi-Supervised Training Method for Data-Efficient Singing Voice Synthesis via Classifier-free Diffusion Guidance

Semin Kim, Myeonghun Jeong, Hyeonseung Lee, Minchan Kim, Byoung Jin Choi

SaSLaW: Dialogue Speech Corpus with Audio-visual Egocentric Information Toward Environment-adaptive Dialogue Speech Synthesis

Osamu Take, Shinnosuke Takamichi, Kentaro Seki, Yoshiaki Bando, Hiroshi Saruwatari

1000 African Voices: Advancing inclusive multi-speaker multi-accent speech synthesis

Sewade Ogun, Abraham T. Owodunni, Tobi Olatunji, Eniola Alese, Babatunde Oladimeji

LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning

Masaya Kawamura, Ryuichi Yamamoto, Yuma Shirahata, Takuya Hasumi, Kentaro Tachibana

MSceneSpeech: A Multi-Scene Speech Dataset For Expressive Speech Synthesis

Qian Yang, Jialong Zuo, Zhe Su, Ziyue Jiang, Mingze Li

WenetSpeech4TTS: A 12,800-hour Mandarin TTS Corpus for Large Speech Generation Model Benchmark

Linhan Ma, Dake Guo, Kun Song, Yuepeng Jiang, Shuai Wang

FLEURS-R: A Restored Multilingual Speech Corpus for Generation Tasks

Min Ma, Yuma Koizumi, Shigeki Karita, Heiga Zen, Jason Riesa

Rasa: Building Expressive Speech Synthesis Systems for Indian Languages in Low-resource Settings

Praveen Srinivasa Varadhan, Ashwin Sankar, Giri Raju, Mitesh M Khapra

SRC4VC: Smartphone-Recorded Corpus for Voice Conversion Benchmark

Yuki Saito, Takuto Igarashi, Kentaro Seki, Shinnosuke Takamichi, Ryuichi Yamamoto

Differentiable Time-Varying Linear Prediction in the Context of End-to-End Analysis-by-Synthesis

Chin-Yun Yu, György Fazekas

Expressive paragraph text-to-speech synthesis with multi-step variational autoencoder

Xuyuan Li, Zengqiang Shang, Peiyang Shi, Hua Hua, Ta Li

EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for Controllable Emotional Text-to-Speech

Deok-Hyeon Cho, Hyung-Seok Oh, Seung-Bin Kim, Sang-Hoon Lee, Seong-Whan Lee

Emotion Arithmetic: Emotional Speech Synthesis via Weight Space Interpolation

Pavan Kalyan, Preeti Rao, Preethi Jyothi, Pushpak Bhattacharyya

Retrieval Augmented Generation in Prompt-based Text-to-Speech Synthesis with Context-Aware Contrastive Language-Audio Pretraining

Jinlong Xue, Yayue Deng, Yingming Gao, Ya Li

Controlling Emotion in Text-to-Speech with Natural Language Prompts

Thomas Bott, Florian Lux, Ngoc Thang Vu