Skip to content
conftrace_

Interspeech 2024

1,065 papers

Text-aware and Context-aware Expressive Audiobook Speech Synthesis

Dake Guo, Xinfa Zhu, Liumeng Xue, Yongmao Zhang, Wenjie Tian

Spontaneous Style Text-to-Speech Synthesis with Controllable Spontaneous Behaviors Based on Language Models

Weiqin Li, Peiji Yang, Yicheng Zhong, Yixuan Zhou, Zhisheng Wang

TSP-TTS: Text-based Style Predictor with Residual Vector Quantization for Expressive Text-to-Speech

Donghyun Seong, Hoyoung Lee, Joon-Hyuk Chang

GTR-Voice: Articulatory Phonetics Informed Controllable Expressive Speech Synthesis

Zehua Kcriss Li, Meiying Melissa Chen, Yi Zhong, Pinxin Liu, Zhiyao Duan

CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systems

Haibin Wu, Yuan Tseng, Hung-yi Lee

A Low-Bitrate Neural Audio Codec Framework with Bandwidth Reduction and Recovery for High-Sampling-Rate Waveforms

Yang Ai, Ye-Xin Lu, Xiao-Hang Jiang, Zheng-Yan Sheng, Rui-Chen Zheng

Speech quality evaluation of neural audio codecs

Thomas Müller, Stephane Ragot, Laetitia Gros, Pierrick Philippe, Pascal Scalart

On Improving Error Resilience of Neural End-to-End Speech Coders

Kishan Gupta, Nicola Pia, Srikanth Korse, Andreas Brendel, Guillaume Fuchs

BS-PLCNet 2: Two-stage Band-split Packet Loss Concealment Network with Intra-model Knowledge Distillation

Zihan Zhang, Xianjun Xia, Chuanzeng Huang, Yijian Xiao, Lei Xie

TD-PLC: A Semantic-Aware Speech Encoding for Improved Packet Loss Concealment

Jinghong Zhang, Zugang Zhao, Yonghui Liu, Jianbing Liu, Zhiqiang He

Beyond Performance Plateaus: A Comprehensive Study on Scalability in Speech Enhancement

Wangyou Zhang, Kohei Saijo, Jee-weon Jung, Chenda Li, Shinji Watanabe

Are Recent Deep Learning-Based Speech Enhancement Methods Ready to Confront Real-World Noisy Environments?

Candy Olivia Mawalim, Shogo Okada, Masashi Unoki

Reducing Speech Distortion and Artifacts for Speech Enhancement by Loss Function

Haixin Guan, Wei Dai, Guangyong Wang, Xiaobin Tan, Peng Li

An Exploration of Length Generalization in Transformer-Based Speech Enhancement

Qiquan Zhang, Hongxu Zhu, Xinyuan Qian, Eliathamby Ambikairajah, Haizhou Li

Improving Speech Enhancement by Integrating Inter-Channel and Band Features with Dual-branch Conformer

Jizhen Li, Xinmeng Xu, Weiping Tu, Yuhong Yang, Rong Zhu

Neural Network Augmented Kalman Filter for Robust Acoustic Howling Suppression

YIXUAN ZHANG, Hao Zhang, Meng Yu, Dong Yu

Improved Remixing Process for Domain Adaptation-Based Speech Enhancement by Mitigating Data Imbalance in Signal-to-Noise Ratio

Li Li, Shogo Seki

DNN-based monaural speech enhancement using alternate analysis windows for phase and magnitude modification

Xi Liu, John H.L. Hansen

RaD-Net 2: A causal two-stage repairing and denoising speech enhancement network with knowledge distillation and complex axial self-attention

Mingshuai Liu, Zhuangqi Chen, Xiaopeng Yan, Yuanjun Lv, Xianjun Xia

Enhanced Feature Learning with Normalized Knowledge Distillation for Audio Tagging

Yuwu Tang, Ziang Ma, Haitao Zhang

BTS: Bridging Text and Sound Modalities for Metadata-Aided Respiratory Sound Classification

June-Woo Kim, Miika Toikkanen, Yera Choi, Seoung-Eun Moon, Ho-Young Jung

tinyCLAP: Distilling Constrastive Language-Audio Pretrained Models

Francesco Paissan, Elisabetta Farella

Domain Adaptation for Contrastive Audio-Language Models

Soham Deshmukh, Rita Singh, Bhiksha Raj

Bridging Language Gaps in Audio-Text Retrieval

Zhiyong Yan, Heinrich Dinkel, Yongqing Wang, Jizhong Liu, Junbo Zhang

DiffATR: Diffusion-based Generative Modeling for Audio-Text Retrieval

Yifei Xin, Xuxin Cheng, Zhihong Zhu, Xusheng Yang, Yuexian Zou

Song Data Cleansing for End-to-End Neural Singer Diarization Using Neural Analysis and Synthesis Framework

Hokuto Munakata, Ryo Terashima, Yusuke Fujita

SOMSRED: Sequential Output Modeling for Joint Multi-talker Overlapped Speech Recognition and Speaker Diarization

Naoki Makishima, Naotaka Kawata, Mana Ihori, Tomohiro Tanaka, Shota Orihashi

Speaker Change Detection with Weighted-sum Knowledge Distillation based on Self-supervised Pre-trained Models

Hang Su, Yuxiang Kong, Lichun Fan, peng gao, Yujun Wang

AG-LSEC: Audio Grounded Lexical Speaker Error Correction

Rohit Paturi, Xiang Li, Sundararajan Srinivasan

Exploring Spoken Language Identification Strategies for Automatic Transcription of Multilingual Broadcast and Institutional Speech

Martina Valente, Fabio Brugnara, Giovanni Morrone, Enrico Zovato, Leonardo Badino

Exploring Energy-Based Models for Out-of-Distribution Detection in Dialect Identification

Yaqian Hao, Chenguang Hu, Yingying Gao, Shilei Zhang, Junlan Feng

TalTech-IRIT-LIS Speaker and Language Diarization Systems for DISPLACE 2024

Joonas Kalda, Tanel Alumäe, Martin Lebourdais, Hervé Bredin, Séverin Baroudi

The Second DISPLACE Challenge: DIarization of SPeaker and LAnguage in Conversational Environments

Shareef Babu Kalluri, Prachi Singh, Pratik Roy Chowdhuri, Apoorva Kulkarni, Shikha Baghel

Hybrid-Diarization System with Overlap Post-Processing for the DISPLACE 2024 Challenge

Gabriel Pirlogeanu, Octavian Pascu, Alexandru-Lucian Georgescu, Horia Cucu

ASoBO: Attentive Beamformer Selection for Distant Speaker Diarization in Meetings

Théo Mariotte, Anthony Larcher, Silvio Montrésor, Jean-Hugh Thomas

Once more Diarization: Improving meeting transcription systems through segment-level speaker reassignment

Christoph Boeddeker, Tobias Cord-Landwehr, Reinhold Haeb-Umbach

Multi-latency look-ahead for streaming speaker segmentation

Bilal Rahou, Hervé Bredin

Boosting Cross-Corpus Speech Emotion Recognition using CycleGAN with Contrastive Learning

Jincen Wang, Yan Zhao, Cheng Lu, Chuangao Tang, Sunan Li

Evaluating Transformer-Enhanced Deep Reinforcement Learning for Speech Emotion Recognition

Siddique Latif, Raja Jurdak, Bjorn W. Schuller

WHiSER: White House Tapes Speech Emotion Recognition Corpus

Abinay Reddy Naini, Lucas Goncalves, Mary A. Kohler, Donita Robinson, Elizabeth Richerson

What Does it Take to Generalize SER Model Across Datasets? A Comprehensive Benchmark

Adham Ibrahim, Shady Shehata, Ajinkya Kulkarni, Mukhtar Mohamed, Muhammad Abdul-Mageed

INTERSPEECH 2009 Emotion Challenge Revisited: Benchmarking 15 Years of Progress in Speech Emotion Recognition

Andreas Triantafyllopoulos, Anton Batliner, Simon Rampp, Manuel Milling, Björn Schuller

EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark

Ziyang Ma, Mingjie Chen, Hezhao Zhang, Zhisheng Zheng, Wenxi Chen

The Use of Modifiers and f0 in Remote Referential Communication with Human and Computer Partners

Iona Gessinger, Bistra Andreeva, Benjamin R. Cowan

Voice quality in telephone speech: Comparing acoustic measures between VoIP telephone and high-quality recordings

Chenzi Xu, Jessica Wormald, Paul Foulkes, Philip Harrison, Vincent Hughes

Gender and age based f0-variation in the German Plapper Corpus

Melanie Weirich, Daniel Duran, Stefanie Jannedy

A Study on the Information Mechanism of the 3rd Tone Sandhi Rule in Mandarin Disyllabic Words

Liu Xiaowang, Jinsong Zhang

Impact of the tonal factor on diphthong realizations in Standard Mandarin with Generalized Additive Mixed Models

Chenyu Li, Jalal Al-Tamimi

Preprocessing for acoustic-to-articulatory inversion using real-time MRI movies of Japanese speech

Anna Oura, Hideaki Kikuchi, Tetsunori Kobayashi

Speaker- and Text-Independent Estimation of Articulatory Movements and Phoneme Alignments from Speech

Tobias Weise, Philipp Klumpp, Kubilay Can Demir, Paula Andrea Pérez-Toro, Maria Schuster

Speaker-Independent Acoustic-to-Articulatory Inversion through Multi-Channel Attention Discriminator

Woo-Jin Chung, Hong-Goo Kang

The sub-band cepstrum as a tool for locating local spectral regions of phonetic sensitivity: A first attempt with multi-speaker vowel data

Michael Lambropoulos, Frantz Clermont, Shunichi Ishihara

Using wav2vec 2.0 for phonetic classification tasks: methodological aspects

Lila Kim, Cedric Gendrot

Tradition or Innovation: A Comparison of Modern ASR Methods for Forced Alignment

Rotem Rousso, Eyal Cohen, Joseph Keshet, Eleanor Chodroff

K-means and hierarchical clustering of f0 contours

Constantijn Kaland, Jeremy Steffman, Jennifer Cole

Phonological Feature Detection for US English using the Phonet Library

Harsha Veena Tadavarthy, Austin Jones, Margaret E. L. Renwick

Deciphering Assamese Vowel Harmony with Featural InfoWaveGAN

Sneha Ray Barman, Shakuntala Mahanta, Neeraj Kumar Sharma

The Use of Phone Categories and Cross-Language Modeling for Phone Alignment of Panãra

Emily P. Ahn, Eleanor Chodroff, Myriam Lapierre, Gina-Anne Levow

Toward Fully-End-to-End Listened Speech Decoding from EEG Signals

Jihwan Lee, Aditya Kommineni, Tiantian Feng, Kleanthis Avramidis, Xuan Shi

Towards an End-to-End Framework for Invasive Brain Signal Decoding with Large Language Models

Sheng Feng, Heyang Liu, Yu Wang, Yanfeng Wang

From Sound to Meaning in the Auditory Cortex: A Neuronal Representation and Classification Analysis

Kumar Neelabh, Vishnu Sreekumar

Large Language Model-based FMRI Encoding of Language Functions for Subjects with Neurocognitive Disorder

Yuejiao Wang, Xianmin Gong, Lingwei Meng, Xixin Wu, Helen Meng

Refining Self-supervised Learnt Speech Representation using Brain Activations

HengYu Li, Kangdi Mei, Zhaoci Liu, Yang Ai, Liping Chen

Exploring the Complementary Nature of Speech and Eye Movements for Profiling Neurological Disorders

Yuzhe Wang, Anna Favaro, Thomas Thebaud, Jesus Villalba, Najim Dehak

A Multimodal Framework for the Assessment of the Schizophrenia Spectrum

Gowtham Premananth, Yashish M. Siriwardena, Philip Resnik, Sonia Bansal, Deanna L.Kelly

Towards Intelligent Speech Assistants in Operating Rooms: A Multimodal Model for Surgical Workflow Analysis

Kubilay Can Demir, Belén Lojo Rodríguez, Tobias Weise, Andreas Maier, Seung Hee Yang

Predicting Acute Pain Levels Implicitly from Vocal Features

Jennifer Williams, Eike Schneiders, Henry Card, Tina Seabrooke, Beatrice Pakenham-Walsh

Comparing ambulatory voice measures during daily life with brief laboratory assessments in speakers with and without vocal hyperfunction

Daryush D. Mehta, Jarrad H. Van Stan, Hamzeh Ghasemzadeh, Robert E. Hillman

Self-Supervised Embeddings for Detecting Individual Symptoms of Depression

Sri Harsha Dumpala, Katerina Dikaios, Abraham Nunes, Frank Rudzicz, Rudolf Uher

Developing Multi-Disorder Voice Protocols: A team science approach involving clinical expertise, bioethics, standards, and DEI.

Anaïs Rameau, Satrajit Ghosh, Alexandros Sigaras, Olivier Elemento, Jean-Christophe Belisle-Pipon

Revealing Confounding Biases: A Novel Benchmarking Approach for Aggregate-Level Performance Metrics in Health Assessments

Stefano Goria, Roseline Polle, Salvatore Fara, Nicholas Cummins

Multimodal Fusion for Vocal Biomarkers Using Vector Cross-Attention

Vladimir Despotovic, Abir Elbéji, Petr V. Nazarov, Guy Fagherazzi

Developing an End-to-End Framework for Predicting the Social Communication Severity Scores of Children with Autism Spectrum Disorder

Jihyun Mun, Sunhee Kim, Minhwa Chung

Reference-Free Estimation of the Quality of Clinical Notes Generated from Doctor-Patient Conversations

Mojtaba Kadkhodaie Elyaderani, John Glover, Thomas Schaaf

Automatic Children Speech Sound Disorder Detection with Age and Speaker Bias Mitigation

Gahye Kim, Yunjung Eom, Selina S. Sung, Seunghee Ha, Tae-Jin Yoon

Adversarial Robustness Analysis in Automatic Pathological Speech Detection Approaches

Mahdi Amiri, Ina Kodrasi

Sustained Vowels for Pre- vs Post-Treatment COPD Classification

Andreas Triantafyllopoulos, Anton Batliner, Wolfgang Mayr, Markus Fendler, Florian Pokorny

Exploiting Foundation Models and Speech Enhancement for Parkinson's Disease Detection from Speech in Real-World Operative Conditions

Moreno La Quatra, Maria Francesca Turco, Torbjørn Svendsen, Giampiero Salvi, Juan Rafael Orozco-Arroyave

The MARRYS helmet: A new device for researching and training “jaw dancing”

Vidar Freyr Gudmundsson, Keve Márton Gönczi, Malin Svensson Lundmark, Donna Erickson, Oliver Niebuhr

SER Evals: In-domain and Out-of-domain benchmarking for speech emotion recognition

Mohamed Osman, Daniel Z. Kaplan, Tamer Nadeem

Codecfake: An Initial Dataset for Detecting LLM-based Deepfake Audio

Yi Lu, Yuankun Xie, Ruibo Fu, Zhengqi Wen, Jianhua Tao

Towards measuring fairness in speech recognition: Fair-Speech dataset

Irina-Elena Veliche, Zhuangqun Huang, Vineeth Ayyat Kochaniyan, Fuchun Peng, Ozlem Kalinli

MultiTalk: Enhancing 3D Talking Head Generation Across Languages with Multilingual Video Dataset

Kim Sung-Bin, Lee Chae-Yeon, Gihun Son, Oh Hyun-Bin, Janghoon Ju

MaViLS, a Benchmark Dataset for Video-to-Slide Alignment, Assessing Baseline Accuracy with a Multimodal Alignment Algorithm Leveraging Speech, OCR, and Visual Features

Katharina Anderer, Andreas Reich, Matthias Wölfel

STraDa: A Singer Traits Dataset

Yuexuan Kong, Viet-Anh Tran, Romain Hennequin

GLOBE: A High-quality English Corpus with Global Accents for Zero-shot Speaker Adaptive Text-to-Speech

Wenbin Wang, Yang Song, Sanjay Jha

HebDB: a Weakly Supervised Dataset for Hebrew Speech Processing

Arnon Turetzky, Or Tal, Yael Segal, Yehoshua Dissen, Ella Zeldes

BESST Dataset: A Multimodal Resource for Speech-based Stress Detection and Analysis

Jan Pešán, Vojtěch Juřík, Martin Karafiat, Jan Černocký

Efficient SQA from Long Audio Contexts: A Policy-driven Approach

Alexander Johnson, Peter Plantinga, Pheobe Sun, Swaroop Gadiyaram, Abenezer Girma

Towards Speech Classification from Acoustic and Vocal Tract data in Real-time MRI

Yaoyao Yue, Michael Proctor, Luping Zhou, Rijul Gupta, Tharinda Piyadasa

Textless Dependency Parsing by Labeled Sequence Prediction

Shunsuke Kando, Yusuke Miyao, Jason Naradowsky, Shinnosuke Takamichi

VN-SLU: A Vietnamese Spoken Language Understanding Dataset

Tuyen Tran, Khanh Le, Ngoc Dang Nguyen, Minh Vu, Huyen Ngo

Prompting Whisper for QA-driven Zero-shot End-to-end Spoken Language Understanding

Mohan Li, Simon Keizer, Rama Doddipatla

AR-NLU: A Framework for Enhancing Natural Language Understanding Model Robustness against ASR Errors

Emmy Phung, Harsh Deshpande, Ahmad Emami, Kanishk Singh

Efficiently Train ASR Models that Memorize Less and Perform Better with Per-core Clipping

Lun Wang, Om Thakkar, Zhong Meng, Nicole Rafidi, Rohit Prabhavalkar

Investigating ASR Error Correction with Large Language Model and Multilingual 1-best Hypotheses

Sheng Li, Chen Chen, Chin Yuen Kwok, Chenhui Chu, Eng Siong Chng

An efficient text augmentation approach for contextualized Mandarin speech recognition

Naijun Zheng, Xucheng Wan, Kai Liu, Ziqing Du, Zhou Huan

Enhancing Dysarthric Speech Recognition for Unseen Speakers via Prototype-Based Adaptation

Shiyao Wang, Shiwan Zhao, Jiaming Zhou, Aobo Kong, Yong Qin

Dysarthric Speech Recognition Using Curriculum Learning and Articulatory Feature Embedding

I-Ting Hsieh, Chung-Hsien Wu

Fine-Tuning Strategies for Dutch Dysarthric Speech Recognition: Evaluating the Impact of Healthy, Disease-Specific, and Speaker-Specific Data

Spyretta Leivaditi, Tatsunari Matsushima, Matt Coler, Shekhar Nayak, Vass Verkhodanova