Interspeech 2023

1,141 papers

ECAPA++: Fine-grained Deep Embedding Learning for TDNN Based Speaker Verification

Bei Liu, Yanmin Qian

Reversible Neural Networks for Memory-Efficient Speaker Verification

Bei Liu, Yanmin Qian

Are retroflex-to-dental sibilant substitutions in Polish children's speech an example of a covert contrast? A preliminary acoustic study

Zuzanna Miodonska, Claartje Levelt, Natalia Mocko, Michał Kręcichwost, Agata Sage

BASEN: Time-Domain Brain-Assisted Speech Enhancement Network with Convolutional Cross Attention in Multi-talker Conditions

Jie Zhang, QingTian Xu, Qiu-Shi Zhu, Zhen-Hua Ling

Speech-in-Speech Recognition is Modulated by Familiarity to Dialect

Jessica L. L. Chin, Elena Talevska, Mark Antoniou

Emotion Prompting for Speech Emotion Recognition

Xingfa Zhou, Min Li, Lan Yang, Rui Sun, Xin Wang

Investigating the Perception Production Link through Perceptual Adaptation and Phonetic Convergence

Lena-Marie Huttner, Noël Nguyen, Martin J. Pickering

What influences the foreign accent strength? Phonological and grammatical errors in the perception of accentedness

Sarah Wesołek, Piotr Gulgowski, Joanna Błaszczak, Marzena Żygis

An Improved End-to-End Audio-Visual Speech Recognition Model

Sheng Yang, Zheng Gong, Jia Kang

Using Random Forests to classify language as a function of syllable timing in two groups: children with cochlear implants and with normal hearing

Mark Gibson

Estimating virtual targets for lingual stop consonants using general Tau theory

Benjamin Elie, Alice Turk

Combining acoustic and aerodynamic data collection: A perceptual evaluation of acoustic distortions

Amélie Elmerich, Jiayin Gao, Angelique Amelot, Lise Crevier-Buchman, Shinji Maeda

The effect of stress on Mandarin tonal perception in continuous speech for Spanish-speaking learners

Lixia Hao, Qi Gong, Jinsong Zhang

Automatic Deep Neural Network-Based Segmental Pronunciation Error Detection of L2 English Speech (L1 Bengali)

Puja Bharati, Sabyasachi Chandra, Shayamal Kumar Das Mandal

The Effect of Whistled Vowels on Whistled Word Categorization for Naive Listeners

Anaïs Tran Ngoc, Fanny Meunier, Julien Meyer

The effect of masking noise on listeners’ spectral tilt preferences

Olympia Simantiraki, Yannis Pantazis, Martin Cooke

Human Transcription Quality Improvement

Jian Gao, Hanbo Sun, Cheng Cao, Zheng Du

ChatGPT-EDSS: Empathetic Dialogue Speech Synthesis Trained from ChatGPT-derived Context Word Embeddings

Yuki Saito, Shinnosuke Takamichi, Eiji Iimori, Kentaro Tachibana, Hiroshi Saruwatari

LightVoc: An Upsampling-Free GAN Vocoder Based On Conformer And Inverse Short-time Fourier Transform

Dinh Son Dang, Tung Lam Nguyen, Bao Thang Ta, Tien Thanh Nguyen, Thi Ngoc Anh Nguyen

UnitSpeech: Speaker-adaptive Speech Synthesis with Untranscribed Data

Heeseung Kim, Sungwon Kim, Jiheum Yeom, Sungroh Yoon

SALTTS: Leveraging Self-Supervised Speech Representations for improved Text-to-Speech Synthesis

Ramanan Sivaguru, Vasista Sai Lodagala, S Umesh

Adapter-Based Extension of Multi-Speaker Text-To-Speech Model for New Speakers

Cheng-Ping Hsieh, Subhankar Ghosh, Boris Ginsburg

Adversarial Learning of Intermediate Acoustic Feature for End-to-End Lightweight Text-to-Speech

Hyungchan Yoon, Seyun Um, ChangHwan Kim, Hong-Goo Kang

Behavioral Analysis of Pathological Speaker Embeddings of Patients During Oncological Treatment of Oral Cancer

Jenthe Thienpondt, Caroline M. Speksnijder, Kris Demuynck

Careful Whisper - leveraging advances in automatic speech recognition for robust and interpretable aphasia subtype classification

Mario Zusag, Laurin Wagner, Theresa Bloder

Cross-Lingual Features for Alzheimer’s Dementia Detection from Speech

Thomas Melistas, Lefteris Kapelonis, Nikos Antoniou, Petros Mitseas, Dimitris Sgouropoulos

Automated Multiple Sclerosis Screening Based on Encoded Speech Representations

José Egas-López, Veronika Svindt, Judit Bóna, Ildikó Hoffmann, Gábor Gosztolya

ReCLR: Reference-Enhanced Contrastive Learning of Audio Representation for Depression Detection

Pingyue Zhang, Mengyue Wu, Kai Yu

A Pipeline to Evaluate the Effects of Noise on Machine Learning Detection of Laryngeal Cancer

Mary Paterson, James Moor, Luisa Cutillo

Self-Supervised Acoustic Word Embedding Learning via Correspondence Transformer Encoder

Jingru Lin, Xianghu Yue, Junyi Ao, Haizhou Li

Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clustering

Heng-Jui Chang, Alexander H. Liu, James Glass

CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning

Chutong Meng, Junyi Ao, Tom Ko, Mingxuan Wang, Haizhou Li

Evaluating context-invariance in unsupervised speech representations

Mark Hallap, Emmanuel Dupoux, Ewan Dunbar

Self-supervised Predictive Coding Models Encode Speaker and Phonetic Information in Orthogonal Subspaces

Oli Danyi Liu, Hao Tang, Sharon Goldwater

ProsAudit, a prosodic benchmark for self-supervised speech models

Maureen de Seyssel, Marvin Lavechin, Hadrien Titeux, Arthur Thomas, Gwendal Virlet

Contrastive Disentangled Learning for Memory-Augmented Transformer

Jen-Tzung Chien, Shang-En Li

Sequence-Level Knowledge Distillation for Class-Incremental End-to-End Spoken Language Understanding

Umberto Cappellazzo, Muqiao Yang, Daniele Falavigna, Alessio Brutti

Audio Retrieval with WavText5K and CLAP Training

Soham Deshmukh, Benjamin Elizalde, Huaming Wang

Transfer Learning from Pre-trained Language Models Improves End-to-End Speech Summarization

Kohei Matsuura, Takanori Ashihara, Takafumi Moriya, Tomohiro Tanaka, Takatomo Kano

Relation-based Counterfactual Data Augmentation and Contrastive Learning for Robustifying Natural Language Inference Models

Heerin Yang, Seung-won Hwang, Jungmin So

Leveraging Pretrained ASR Encoders for Effective and Efficient End-to-End Speech Intent Classification and Slot Filling

He Huang, Jagadeesh Balam, Boris Ginsburg

Text-only domain adaptation for end-to-end ASR using integrated text-to-mel-spectrogram generator

Vladimir Bataev, Roman Korostik, Evgeny Shabalin, Vitaly Lavrukhin, Boris Ginsburg

Multi-pass Training and Cross-information Fusion for Low-resource End-to-end Accented Speech Recognition

Xuefei Wang, Yanhua Long, Yijie Li, Haoran Wei

Dual-Path Style Learning for End-to-End Noise-Robust Speech Recognition

Yuchen Hu, Nana Hou, Chen Chen, Eng Siong Chng

Joint Autoregressive Modeling of End-to-End Multi-Talker Overlapped Speech Recognition and Utterance-level Timestamp Prediction

Naoki Makishima, Keita Suzuki, Satoshi Suzuki, Atsushi Ando, Ryo Masumura

Improving Frame-level Classifier for Word Timings with Non-peaky CTC in End-to-End Automatic Speech Recognition

Xianzhao Chen, Yist Y. Lin, Kang Wang, Yi He, Zejun Ma

End-to-End Joint Target and Non-Target Speakers ASR

Ryo Masumura, Naoki Makishima, Taiga Yamane, Yoshihiko Yamazaki, Saki Mizuno

What is Learnt by the LEArnable Front-end (LEAF)? Adapting Per-Channel Energy Normalisation (PCEN) to Noisy Conditions

Hanyu Meng, Vidhyasaharan Sethu, Eliathamby Ambikairajah

Comparison of GIF- and SSL-based Features in Pathological-voice Detection

Akira Sasou, Yang Chen

SpeechGLUE: How Well Can Self-Supervised Speech Models Capture Linguistic Knowledge?

Takanori Ashihara, Takafumi Moriya, Kohei Matsuura, Tomohiro Tanaka, Yusuke Ijima

An Information-Theoretic Analysis of Self-supervised Discrete Representations of Speech

Badr M. Abdullah, Mohammed Maqsood Shaik, Bernd Möbius, Dietrich Klakow

An extension of disentanglement metrics and its application to voice

Olivier Zhang, Olivier Le Blouch, Nicolas Gengembre, Damien Lolive

Speech Self-Supervised Representation Benchmarking: Are We Doing it Right?

Salah Zaiem, Youcef Kemiche, Titouan Parcollet, Slim Essid, Mirco Ravanelli

Malafide: a novel adversarial convolutive noise attack against deepfake and spoofing detection systems

Michele Panariello, Wanying Ge, Hemlata Tak, Massimiliano Todisco, Nicholas Evans

Vocoder drift in x-vector–based speaker anonymization

Michele Panariello, Massimiliano Todisco, Nicholas Evans

Privacy-preserving Representation Learning for Speech Understanding

Minh Tran, Mohammad Soleymani

Efficient Encoder-Decoder and Dual-Path Conformer for Comprehensive Feature Learning in Speech Enhancement

Junyu Wang

eSTImate: A Real-time Speech Transmission Index Estimator With Speech Enhancement Auxiliary Task Using Self-Attention Feature Pyramid Network

Bajian Xiang, Hongkun Liu, Zedong Wu, Su Shen, Xiangdong Zhang

Masking Kernel for Learning Energy-Efficient Representations for Speaker Recognition and Mobile Health

Apiwat Ditthapron, Emmanuel O. Agu, Adam C. Lammert

Visually-Aware Audio Captioning With Adaptive Audio-Visual Attention

Xubo Liu, Qiushi Huang, Xinhao Mei, Haohe Liu, Qiuqiang Kong

MCR-Data2vec 2.0: Improving Self-supervised Speech Pre-training via Model-level Consistency Regularization

Ji Won Yoon, Seok Min Kim, Nam Soo Kim

FlexiAST: Flexibility is What AST Needs

Jiu Feng, Mehmet Hamza Erol, Joon Son Chung, Arda Senocak

Variational Classifier for Unsupervised Anomalous Sound Detection under Domain Generalization

Antonio Almudévar, Alfonso Ortega, Luis Vicente, Antonio Miguel, Eduardo Lleida

DeCoR: Defy Knowledge Forgetting by Predicting Earlier Audio Codes

Xilin Jiang, Yinghao Aaron Li, Nima Mesgarani

Application of Knowledge Distillation to Multi-Task Speech Representation Learning

Mine Kerpicci, Van Nguyen, Shuhua Zhang, Erik Visser

Learning A Self-Supervised Domain-Invariant Feature Representation for Generalized Audio Deepfake Detection

Yuankun Xie, Haonan Cheng, Yutian Wang, Long Ye

Synthetic Voice Spoofing Detection based on Feature Pyramid Conformer

Jingran Gong, Ning Chen

Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong General Audio Event Taggers

Yuan Gong, Sameer Khurana, Leonid Karlinsky, James Glass

Insights into end-to-end audio-to-score transcription with real recordings: A case study with saxophone works

Juan Carlos Martínez-Sevilla, María Alfaro-Contreras, Jose J. Valero-Mas, Jorge Calvo-Zaragoza

Advanced RawNet2 with Attention-based Channel Masking for Synthetic Speech Detection

Jing Li, Yanhua Long, Yijie Li, Dongxing Xu

Multi-microphone Automatic Speech Segmentation in Meetings Based on Circular Harmonics Features

Théo Mariotte, Anthony Larcher, Silvio Montrésor, Jean-Hugh Thomas

Semantic Segmentation with Bidirectional Language Models Improves Long-form ASR

W. Ronny Huang, Hao Zhang, Shankar Kumar, Shuo-Yiin Chang, Tara Sainath

Self-Supervised Dataset Pruning for Efficient Training in Audio Anti-spoofing

Abdul Hameed Azeemi, Ihsan Ayyub Qazi, Agha Ali Raza

Few-Shot Open-Set Learning for On-Device Customization of KeyWord Spotting Systems

Manuele Rusci, Tinne Tuytelaars

Masked Audio Modeling with CLAP and Multi-Objective Learning

Yifei Xin, Xiulian Peng, Yan Lu

Towards Attention-based Contrastive Learning for Audio Spoof Detection

Chirag Goel, Surya Koppisetti, Ben Colman, Ali Shahriyari, Gaurav Bharaj

Joint-Former: Jointly Regularized and Locally Down-sampled Conformer for Semi-supervised Sound Event Detection

Lijian Gao, Qirong Mao, Ming Dong

Wav2ToBI: a new approach to automatic ToBI transcription

Wanyue Zhai, Mark Hasegawa-Johnson

GRAVO: Learning to Generate Relevant Audio from Visual Features with Noisy Online Videos

Youngdo Ahn, Chengyi Wang, Yu Wu, Jong Won Shin, Shujie LIU

Random Forest Classification of Breathing Phases from Audio Signals Recorded using Mobile Devices

Vitória S. Fahed, Emer P Doheny, Madeleine M Lowery

Anomalous Sound Detection Based on Sound Separation

Kanta Shimonishi, Kota Dohi, Yohei Kawaguchi

Emotion-Aware Audio-Driven Face Animation via Contrastive Feature Disentanglement

Xin Ren, Juan Luo, Xionghu Zhong, Minjie Cai

Blind Estimation of Room Impulse Response from Monaural Reverberant Speech with Segmental Generative Neural Network

Zhiheng Liao, Feifei Xiong, Juan Luo, Minjie Cai, Eng Siong Chng

Speaker-aware Cross-modal Fusion Architecture for Conversational Emotion Recognition

Huan Zhao, Bo Li, Zixing Zhang

Relationships Between Gender, Personality Traits and Features of Multi-Modal Data to Responses to Spoken Dialog Systems Breakdown

Kazuya Tsubokura, Yurie Iribe, Norihide Kitaoka

Quantifying the perceptual value of lexical and non-lexical channels in speech

Sarenne Wallbridge, Peter Bell, Catherine Lai

Speech-Based Classification of Defensive Communication: A Novel Dataset and Results

Shahin Amiriparian, Lukas Christ, Regina Kushtanova, Maurice Gerczuk, Alexandra Teynor

Verbal and nonverbal feedback signals in response to increasing levels of miscommunication

Maëva Garnier, Eric Le Ferrand, Fabien Ringeval

I Learned Error, I Can Fix It! : A Detector-Corrector Structure for ASR Error Calibration

Heui-Yeen Yeen, Min-Ju Kim, Myoung-Wan Koo

Listening To Silences In Contact Center Conversations Using Textual Cues

Digvijay Anil Ingle, Ayush Kumar, Jithendra Vepa

Abusive Speech Detection in Indic Languages Using Acoustic Features

Anika A. Spiesberger, Andreas Triantafyllopoulos, Iosif Tsangko, Bjorn W. Schuller

A Multiple-Teacher Pruning Based Self-Distillation (MT-PSD) Approach to Model Compression for Audio-Visual Wake Word Spotting

Haotian Wang, Jun Du, Hengshun Zhou, Chin-Hui Lee, Yuling Ren

Focus-attention-enhanced Crossmodal Transformer with Metric Learning for Multimodal Speech Emotion Recognition

Keulbit Kim, Namhyun Cho

Improving the response timing estimation for spoken dialogue systems by reducing the effect of speech recognition delay

Jin Sakuma, Shinya Fujie, Huaibo Zhao, Tetsunori Kobayashi

Audio-Visual Praise Estimation for Conversational Video based on Synchronization-Guided Multimodal Transformer

Nobukatsu Hojo, Saki Mizuno, Satoshi Kobashikawa, Ryo Masumura, Mana Ihori

Multimodal Turn-Taking Model Using Visual Cues for End-of-Utterance Prediction in Spoken Dialogue Systems

Fuma Kurata, Mao Saeki, Shinya Fujie, Yoichi Matsuyama

Rapid Lexical Alignment to a Conversational Agent

Rachel Ostrand, Victor S. Ferreira, David Piorkowski

Efficient Multimodal Neural Networks for Trigger-less Voice Assistants

Sai Srujana Buddi, Utkarsh Oggy Sarawgi, Tashweena Heeramun, Karan Sawnhey, Ed Yanosik

Parameter Selection for Analyzing Conversations with Autism Spectrum Disorder

Tahiya Chowdhury, Veronica Romero, Amanda Stent

Estimation of Listening Response Timing by Generative Model and Parameter Control of Response Substantialness Using Dynamic-Prompt-Tune

Toshiki Muromachi, Yoshinobu Kano