Interspeech 2024

1,065 papers

Hierarchical Distribution Adaptation for Unsupervised Cross-corpus Speech Emotion Recognition

Cheng Lu, Yuan Zong, Yan Zhao, Hailun Lian, Tianhua Qi

Keep, Delete, or Substitute: Frame Selection Strategy for Noise-Robust Speech Emotion Recognition

Seong-Gyun Leem, Daniel Fulford, Jukka-Pekka Onnela, David Gard, Carlos Busso

Enrolment-based personalisation for improving individual-level fairness in speech emotion recognition

Andreas Triantafyllopoulos, Björn Schuller

Multimodal Fusion of Music Theory-Inspired and Self-Supervised Representations for Improved Emotion Recognition

Xiaohan Shi, Xingfeng Li, Tomoki Toda

MFDR: Multiple-stage Fusion and Dynamically Refined Network for Multimodal Emotion Recognition

Ziping Zhao, Tian Gao, Haishuai Wang, Björn Schuller

Can Modelling Inter-Rater Ambiguity Lead To Noise-Robust Continuous Emotion Predictions?

Ya-Tse Wu, Jingyao Wu, Vidhyasaharan Sethu, Chi-Chun Lee

Intrusive schwa within French stop-liquid clusters: An acoustic analysis

Minmin Yang, Rachid Ridouane

Voiced and voiceless laterals in Angami

Viyazonuo Terhiija, Priyankoo Sarmah

Affricates in Lushootseed

Ted Kye

Nasal Air Flow During Speech Production In Korebaju

Jenifer Vega Rodríguez, Nathalie Vallée, Christophe Savariaux, Silvain Gerber

Crosslinguistic Comparison of Acoustic Variation in the Vowel Sequences /ia/ and /io/ in Four Romance Languages

Johanna Cronenberg, Ioana Chitoran, Lori Lamel, Ioana Vasilescu

Prosodic marking of syntactic boundaries in Khoekhoe

Kira Tulchynska, Sylvanus Job, Alena Witzlack-Makarevich, Margaret Zellers

Evaluating Italian Vowel Variation with the Recurrent Neural Network Phonet

Austin Jones, Margaret E. L. Renwick

A comparison of voice similarity through acoustics, human perception and deep neural network (DNN) speaker verification systems

Suyuan Liu, Molly Babel, Jian Zhu

Do Speaker-dependent Vowel Characteristics depend on Speech Style?

Nicolas Audibert, Cécile Fougeron, Christine Meunier

Preservation, conservation and phonetic study of the voices of Italian poets: A study on the seven years of the VIP archive

Federico Lo Iacono, Valentina Colonna, Antonio Romano

NumberLie: a game-based experiment to understand the acoustics of deception and truthfulness

Alessandro De Luca, Andrew Clark, Volker Dellwo

Speaker Detection by the Individual Listener and the Crowd: Parametric Models Applicable to Bonafide and Deepfake Speech

Tomi H. Kinnunen, Rosa Gonzalez Hautamäki, Xin Wang, Junichi Yamagishi

A toolkit for joint speaker diarization and identification with application to speaker-attributed ASR

Giovanni Morrone, Enrico Zovato, Fabio Brugnara, Enrico Sartori, Leonardo Badino

Gryannote open-source speaker diarization labeling tool

Clément Pages, Hervé Bredin

PhoneViz: exploring alignments at a glance

Margot Masson, Erfan A. Shams, Iona Gessinger, Julie Carson-berndsen

ATTEST: an analytics tool for the testing and evaluation of speech technologies

Dmitrii Obukhov, Marcel de Korte, Andrey Adaschik

The reasonable effectiveness of speaker embeddings for violence detection

Sarthak Jain, Orchid Chetia Phukan, Arun Balaji Buduru, Rajesh Sharma

ComFeAT: combination of neural and spectral features for improved depression detection

Orchid Chetia Phukan, Sarthak Jain, Shubham Singh, Muskaan Singh, Arun Balaji Buduru

NeuRO: an application for code-switched autism detection in children

Mohd Mujtaba Akhtar, Girish, Orchid Chetia Phukan, Muskaan Singh

PERSONA: an application for emotion recognition, gender recognition and age estimation

Devyani Koshal, Orchid Chetia Phukan, Sarthak Jain, Arun Balaji Buduru, Rajesh Sharma

ASGIR: audio spectrogram transformer guided classification and information retrieval for birds

Yashwardhan Chaudhuri, Paridhi Mundra, Arnesh Batra, Orchid Chetia Phukan, Arun Balaji Buduru

AVR: synergizing foundation models for audio-visual humor detection

Sarthak Sharma, Orchid Chetia Phukan, Drishti Singh, Arun Balaji Buduru, Rajesh Sharma

VoxMed: one-step respiratory disease classifier using digital stethoscope sounds

Paridhi Mundra, Manik Sharma, Yashwardhan Chaudhuri, Orchid Chetia Phukan, Arun Balaji Buduru

OCEAN-AI: open multimodal framework for personality traits assessment and HR-processes automatization

Elena Ryumina, Dmitry Ryumin, Alexey Karpov

Orthogonality and isotropy of speaker and phonetic information in self-supervised speech representations

Mukhtar Mohamed, Oli Danyi Liu, Hao Tang, Sharon Goldwater

Spoken-Term Discovery using Discrete Speech Units

Benjamin Van Niekerk, Julian Zaïdi, Marc-André Carbonneau, Herman Kamper

The Difficulty and Importance of Estimating the Lower and Upper Bounds of Infant Speech Exposure

Joseph Coffey, Okko Rasanen, Camila Scaff, Alejandrina Cristia

A data-driven model of acoustic speech intelligibility for optimization-based models of speech production

Benjamin Elie, Juraj Simko, Alice Turk

Dirichlet process mixture model based on topologically augmented signal representation for clustering infant vocalizations

Guillem Bonafos, Clara Bourot, Pierre Pudlo, Jean-Marc Freyermuth, Laurence Reboul

A Pilot Study of GSLM-based Simulation of Foreign Accentuation Only Using Native Speech Corpora

Kentaro Onda, Joonyong Park, Nobuaki Minematsu, Daisuke Saito

Simulating articulatory trajectories with phonological feature interpolation

Angelo Ortiz Tandazo, Thomas Schatz, Thomas Hueber, Emmanuel Dupoux

Neurocomputational model of speech recognition for pathological speech detection: a case study on Parkinson's disease speech detection

Sevada Hovsepyan, Mathew Magimai.-Doss

Information-theoretic hypothesis generation of relative cue weighting for the voicing contrast

Annika Heuser, Jianjing Kuang

Investigation of look-ahead techniques to improve response time in spoken dialogue system

Masaya Ohagi, Tomoya Mizumoto, Katsumasa Yoshikawa

Uh, um and mh: Are filled pauses prone to conversational converge?

Mathilde Hutin, Junfei Hu, Liesbeth Degand

Backchannel prediction, based on who, when and what

Yo-Han Park, Wencke Liermann, Yong-Seok Choi, Seung Hi Kim, Jeong-Uk Bang

Utilization of Text Data for Response Timing Detection in Attentive Listening

Yu Watanabe, Koichiro Ito, Shigeki Matsubara

Detecting the terminality of speech-turn boundary for spoken interactions in French TV and Radio content

Rémi Uro, Marie Tahon, David Doukhan, Antoine Laurent, Albert Rilliard

Investigating the Influence of Stance-Taking on Conversational Timing of Task-Oriented Speech

Sara Ng, Gina-Anne Levow, Mari Ostendorf, Richard Wright

Target conversation extraction: Source separation using turn-taking dynamics

Tuochao Chen, Qirui Wang, Bohan Wu, Malek Itani, Emre Sefik Eskimez

Applying Reinforcement Learning and Multi-Generators for Stage Transition in an Emotional Support Dialogue System

Jeremy Chang, Kuan-Yu Chen, Chung-Hsien Wu

Automated Human-Readable Label Generation in Open Intent Discovery

Grant Anderson, Emma Hart, Dimitra Gkatzia, Ian Beaver

Unified Framework for Spoken Language Understanding and Summarization in Task-Based Human Dialog processing

Eunice Akani, Frédéric Béchet, Benoit Favre, Romain Gemignani

This Paper Had the Smartest Reviewers - Flattery Detection Utilising an Audio-Textual Transformer-Based Approach

Lukas Christ, Shahin Amiriparian, Friederike Hawighorst, Ann-Kathrin Schill, Angelo Boutalikakis

An Uyghur Extension to the MASSIVE Multi-lingual Spoken Language Understanding Corpus with Comprehensive Evaluations

Ainikaerjiang Aimaiti, Di Wu, Liting Jiang, Gulinigeer Abudouwaili, Hao Huang

RASU: Retrieval Augmented Speech Understanding through Generative Modeling

Hao Yang, Min Zhang, Minghan Wang, Jiaxin Guo

Transformer-based Model for ASR N-Best Rescoring and Rewriting

Iwen E Kang, Christophe Van Gysel, Man-Hung Siu

Error Correction by Paying Attention to Both Acoustic and Confidence References for Automatic Speech Recognition

Yuchun Shu, Bo Hu, Yifeng He, Hao Shi, Longbiao Wang

HypR: A comprehensive study for ASR hypothesis revising with a reference corpus

Yi-Wei Wang, Ke-Han Lu, Kuan-Yu Chen

LI-TTA: Language Informed Test-Time Adaptation for Automatic Speech Recognition

Eunseop Yoon, Hee Suk Yoon, John Harvill, Mark Hasegawa-Johnson, Chang D. Yoo

SALSA: Speedy ASR-LLM Synchronous Aggregation

Ashish Mittal, Darshan Prabhu, Sunita Sarawagi, Preethi Jyothi

Linear-Complexity Self-Supervised Learning for Speech Processing

Shucong Zhang, Titouan Parcollet, Rogier van Dalen, Sourav Bhattacharya

Conformer without Convolutions

Matthijs Van keirsbilck, Alexander Keller

RepCNN: Micro-sized, Mighty Models for Wakeword Detection

Arnav Kundu, Prateeth Nayak, Priyanka Padmanabhan, Devang Naik

Boosting Hybrid Autoregressive Transducer-based ASR with Internal Acoustic Model Training and Dual Blank Thresholding

Takafumi Moriya, Takanori Ashihara, Masato Mimura, Hiroshi Sato, Kohei Matsuura

SummaryMixing: A Linear-Complexity Alternative to Self-Attention for Speech Recognition and Understanding

Titouan Parcollet, Rogier van Dalen, Shucong Zhang, Sourav Bhattacharya

Contemplative Mechanism for Speech Recognition: Speech Encoders can Think

Tien-Ju Yang, Andrew Rosenberg, Bhuvana Ramabhadran

FastLips: an End-to-End Audiovisual Text-to-Speech System with Lip Features Prediction for Virtual Avatars

Martin Lenglet, Olivier Perrotin, Gérard Bailly

High Fidelity Text-to-Speech Via Discrete Tokens Using Token Transducer and Group Masked Language Model

Joun Yeop Lee, Myeonghun Jeong, Minchan Kim, Ji-Hyun Lee, Hoon-Young Cho

Phonetic Enhanced Language Modeling for Text-to-Speech Synthesis

Kun Zhou, Shengkui Zhao, Yukun Ma, Chong Zhang, Hao Wang

FluentEditor: Text-based Speech Editing by Considering Acoustic and Prosody Consistency

Rui Liu, Jiatian Xi, Ziyue Jiang, Haizhou Li

Synthesizing Long-Form Speech merely from Sentence-Level Corpus with Content Extrapolation and LLM Contextual Enrichment

Shijie Lai, Minglu He, Zijing Zhao, Kai Wang, Hao Huang

Improving Robustness of LLM-based Speech Synthesis by Learning Monotonic Alignment

Paarth Neekhara, Shehzeen Hussain, Subhankar Ghosh, Jason Li, Boris Ginsburg

Small-E: Small Language Model with Linear Attention for Efficient Speech Synthesis

Théodor Lemerle, Nicolas Obin, Axel Roebel

Modeling Vocal Tract Like Acoustic Tubes Using the Immersed Boundary Method

Rongshuai Wu, Debasish Ray Mohapatra, Sidney Fels

Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning

Chung-Ming Chien, Andros Tjandra, Apoorv Vyas, Matt Le, Bowen Shi

Multi-modal Adversarial Training for Zero-Shot Voice Cloning

John Janiczek, Dading Chong, Dongyang Dai, Arlo Faria, Chao Wang

ClariTTS: Feature-ratio Normalization and Duration Stabilization for Code-mixed Multi-speaker Speech Synthesis

ChangHwan Kim

LiveSpeech: Low-Latency Zero-shot Text-to-Speech via Autoregressive Modeling of Audio Discrete Codes

Trung Dang, David Aponte, Dung Tran, Kazuhito Koishida

Single-Codec: Single-Codebook Speech Codec towards High-Performance Speech Generation

Hanzhao Li, Liumeng Xue, Haohan Guo, Xinfa Zhu, Yuanjun Lv

Low-dimensional Style Token Control for Hyperarticulated Speech Synthesis

Miku Nishihara, Dan Wells, Korin Richmond, Aidan Pine

An Attribute Interpolation Method in Speech Synthesis by Model Merging

Masato Murata, Koichi Miyazaki, Tomoki Koriyama

Highly Intelligible Speaker-Independent Articulatory Synthesis

Charles McGhee, Kate Knill, Mark Gales

PLDNet: PLD-Guided Lightweight Deep Network Boosted by Efﬁcient Attention for Handheld Dual-Microphone Speech Enhancement

Nan Zhou, Youhai Jiang, Jialin Tan, Chongmin Qi

DeFTAN-AA: Array Geometry Agnostic Multichannel Speech Enhancement

Dongheon Lee, Jung-Woo Choi

Audio Enhancement from Multiple Crowdsourced Recordings: A Simple and Effective Baseline

Shiran Aziz, Yossi Adi, Shmuel Peleg

FoVNet: Configurable Field-of-View Speech Enhancement with Low Computation and Distortion for Smart Glasses

Zhongweiyang Xu, Ali Aroudi, Ke Tan, Ashutosh Pandey, Jung-Suk Lee

Array Geometry-Robust Attention-Based Neural Beamformer for Moving Speakers

Marvin Tammen, Tsubasa Ochiai, Marc Delcroix, Tomohiro Nakatani, Shoko Araki

Post-Net: A linguistically inspired sequence-dependent transformed neural architecture for automatic syllable stress detection

Sai Harshitha Aluru, Jhansi Mallela, Chiranjeevi Yarra

Neural Compression Augmentation for Contrastive Audio Representation Learning

Zhaoyu Wang, Haohe Liu, Harry Coppock, Björn Schuller, Mark D. Plumbley

Gender and Language Identification in Multilingual Models of Speech: Exploring the Genericity and Robustness of Speech Representations

Séverine Guillaume, Maxime Fily, Alexis Michaud, Guillaume Wisniewski

GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model

Yingying Gao, Shilei Zhang, Chao Deng, Junlan Feng

PAM: Prompting Audio-Language Models for Audio Quality Assessment

Soham Deshmukh, Dareen Alharthi, Benjamin Elizalde, Hannes Gamper, Mahmoud Al Ismail

Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters

Umberto Cappellazzo, Daniele Falavigna, Alessio Brutti

Retrieval-Augmented Classifier Guidance for Audio Generation

Ho-Young Choi, Won-Gook Choi, Joon-Hyuk Chang

Sound of Vision: Audio Generation from Visual Text Embedding through Training Domain Discriminator

Jaewon Kim, Won-Gook Choi, Seyun Ahn, Joon-Hyuk Chang

Exploring compressibility of transformer based text-to-music (TTM) models

Vasileios Moschopoulos, Thanasis Kotsiopoulos, Pablo Peso Parada, Konstantinos Nikiforidis, Alexandros Stergiadis

Phoneme Discretized Saliency Maps for Explainable Detection of AI-Generated Voice

Shubham Gupta, Mirco Ravanelli, Pascal Germain, Cem Subakan

Audio Editing with Non-Rigid Text Prompts

Francesco Paissan, Luca Della Libera, Zhepei Wang, Paris Smaragdis, Mirco Ravanelli

ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation

Yatong Bai, Trung Dang, Dung Tran, Kazuhito Koishida, Somayeh Sojoudi

RevRIR: Joint Reverberant Speech and Room Impulse Response Embedding using Contrastive Learning with Application to Room Shape Classification

Jacob Bitterman, Daniel Levi, Hilel Hagai Diamandi, Sharon Gannot, Tal Rosenwein

Neuromorphic Keyword Spotting with Pulse Density Modulation MEMS Microphones

Sidi Yaya Arnaud Yarga, Sean U N Wood

Design of Feedback Active Noise Cancellation Filter Using Nested Recurrent Neural Networks

Alireza Bayestehtashk, Amit Kumar, Mike Wurtz

Spatial Acoustic Enhancement Using Unbiased Relative Harmonic Coefficients

Liang Tao, Maoshen Jia, Yonggang Hu, Changchun Bao