Interspeech 2023

1,141 papers

The MALACH Corpus: Results with End-to-End Architectures and Pretraining

Michael Picheny, Qin Yang, Daiheng Zhang, Lining Zhang

N-Shot Benchmarking of Whisper on Diverse Arabic Speech Recognition

Bashar Talafha, Abdul Waheed, Muhammad Abdul-Mageed

Svarah: Evaluating English ASR Systems on Indian Accents

Tahir Javed, Sakshi Joshi, Vignesh Nagarajan, Sai Sundaresan, Janki Nawale

Towards Dialect-inclusive Recognition in a Low-resource Language: Are Balanced Corpora the Answer?

Liam Lonergan, Mengjie Qian, Neasa Ní Chiaráin, Christer Gobl, Ailbhe Ni Chasaide

AfriNames: Most ASR Models "Butcher" African Names

Tobi Olatunji, Tejumade Afonja, Bonaventure F. P. Dossou, Atnafu Lambebo Tonja, Chris Chinenye Emezue

Learning Cross-lingual Mappings for Data Augmentation to Improve Low-Resource Speech Recognition

Muhammad Umar Farooq, Thomas Hain

SVVAD: Personal Voice Activity Detection for Speaker Verification

Zuheng Kang, Jianzong Wang, Junqing Peng, Jing Xiao

Real-Time Causal Spectro-Temporal Voice Activity Detection Based on Convolutional Encoding and Residual Decoding

Jingyuan Wang, Jie Zhang, Li-Rong Dai

Point to the Hidden: Exposing Speech Audio Splicing via Signal Pointer Nets

Denise Moussa, Germans Hirsch, Sebastian Wankerl, Christian Riess

Dynamic Encoder RNN for Online Voice Activity Detection in Adverse Noise Conditions

Prithvi R.R. Gudepu, Jayesh M. Koroth, Kamini Sabu, Mahaboob Ali Basha Shaik

Semantic VAD: Low-Latency Voice Activity Detection for Speech Interaction

Mohan Shi, Yuchun Shu, Lingyun Zuo, Qian Chen, Shiliang Zhang

GL-SSD: Global and Local Speech Style Disentanglement by vector quantization for robust sentence boundary detection in speech stream

Kuncai Zhang, Wei Zhou, Pengcheng Zhu, Haiqing Chen

Exploring multi-task learning and data augmentation in dementia detection with self-supervised pretrained models

Minchuan Chen, Chenfeng Miao, Jun Ma, Shaojun Wang, Jing Xiao

Detecting Manifest Huntington's Disease Using Vocal Data

Vinod Subramanian, Namhee Kwon, Raymond Brueckner, Nate Blaylock, Henry O'Connell

Which aspects of motor speech disorder are captured by Mel Frequency Cepstral Coefficients? Evidence from the change in STN-DBS conditions in Parkinson’s disease

Vojtěch Illner, Petr Kryze, Jan Svihlik, Mário Sousa, Paul Krack

Audio-Visual Mandarin Electrolaryngeal Speech Voice Conversion

Yung-Lun Chien, Hsin-Hao Chen, Ming-Chi Yen, Shu-Wei Tsai, Hsin-Min Wang

Mandarin Electrolaryngeal Speech Voice Conversion using Cross-domain Features

Hsin-Hao Chen, Yung-Lun Chien, Ming-Chi Yen, Shu-Wei Tsai, Tai-Shih Chi

Differentiating acoustic and physiological features in speech for hypoxia detection

Benjamin O'Brien, Adrien Gresse, Jean-Baptise Billaud, Guilhem Belda, Jean-Francois Bonastre

F0inTFS: A lightweight periodicity enhancement strategy for cochlear implants

Huali Zhou, Fanhui Kong, Nengheng Zheng, Qinglin Meng

Federated Learning for Secure Development of AI Models for Parkinson’s Disease Detection Using Speech from Different Languages

Soroosh Tayebi Arasteh, Cristian David Rios-Urrego, Elmar Nöth, Andreas Maier, Seung Hee Yang

Score-balanced Loss for Multi-aspect Pronunciation Assessment

Heejin Do, Yunsu Kim, Gary Geunbae Lee

Validation of a Task-Independent Cepstral Peak Prominence Measure with Voice Activity Detection

Olivia M. Murton, Abigail E. Haenssler, Marc F. Maffei, Kathryn P. Connaghan, Jordan Green

Cochlear-implant Listeners Listening to Cochlear-implant Simulated Speech

Fanhui Kong, Nengheng Zheng, Xianren Wang, Hao He, Jan W. H. Schnupp

Hearing Loss Affects Emotion Perception in Older Adults: Evidence from a Prosody-Semantics Stroop Task

Yingyang Wang, Min Xu, Jing Shao, Lan Wang, Nan Yan

Investigating the dynamics of hand and lips in French Cued Speech using attention mechanisms and CTC-based decoding

Sanjana Sankar, Denis Beautemps, Frédéric Elisei, Olivier Perrotin, Thomas Hueber

Multi-View Frequency-Attention Alternative to CNN Frontends for Automatic Speech Recognition

Belen Alastruey, Lukas Drude, Jahn Heymann, Simon Wiesler

Bayes Risk Transducer: Transducer with Controllable Alignment Prediction

Jinchuan Tian, Jianwei Yu, Hangting Chen, Brian Yan, Chao Weng

BAT: Boundary aware transducer for memory-efficient and low-latency ASR

Keyu An, Xian Shi, Shiliang Zhang

wav2vec 2.0 ASR for Cantonese-Speaking Older Adults in a Clinical Setting

Ranzo Huang, Brian Mak

A Unified Recognition and Correction Model under Noisy and Accent Speech Conditions

Zhao Yang, Dianwen Ng, Chong Zhang, Rui Jiang, Wei Xi

Biased Self-supervised Learning for ASR

Florian L. Kreyssig, Yangyang Shi, Jinxi Guo, Leda Sari, Abdel-rahman Mohamed

MMSpeech: Multi-modal Multi-task Encoder-Decoder Pre-training for speech recognition

Xiaohuan Zhou, Jiaming Wang, Zeyu Cui, Shiliang Zhang, Zhijie Yan

Competitive and Resource Efficient Factored Hybrid HMM Systems are Simpler Than You Think

Tina Raissi, Christoph Lüscher, Moritz Gunz, Ralf Schlüter, Hermann Ney

Contextualized End-to-End Speech Recognition with Contextual Phrase Prediction Network

Kaixun Huang, Ao Zhang, Zhanheng Yang, Pengcheng Guo, Bingshen Mu

Dialect Speech Recognition Modeling using Corpus of Japanese Dialects and Self-Supervised Learning-based Model XLSR

Shogo Miwa, Atsuhiko Kai

Fake the Real: Backdoor Attack on Deep Speech Classification via Voice Conversion

Zhe Ye, Terui Mao, Li Dong, Diqun Yan

Multi-channel multi-speaker transformer for speech recognition

Guo Yifan, Tian Yao, Suo Hongbin, Wan Yulong

Time-Domain Speech Enhancement for Robust Automatic Speech Recognition

Yufeng Yang, Ashutosh Pandey, Deliang Wang

2-bit Conformer quantization for automatic speech recognition

Oleg Rybakov, Phoenix Meadowlark, Shaojin Ding, David Qiu, Jian Li

Regarding Topology and Variant Frame Rates for Differentiable WFST-based End-to-End ASR

Zeyu Zhao, Peter Bell

Towards Multi-task Learning of Speech and Speaker Recognition

Nik Vaessen, David A. van Leeuwen

Creating Personalized Synthetic Voices from Post-Glossectomy Speech with Guided Diffusion Models

Yusheng Tian, Guangyan Zhang, Tan Lee

PromptStyle: Controllable Style Transfer for Text-to-Speech with Natural Language Descriptions

Guanghou Liu, Yongmao Zhang, Yi Lei, Yunlin Chen, Rui Wang

ContextSpeech: Expressive and Efficient Text-to-Speech for Paragraph Reading

Yujia Xiao, Shaofei Zhang, Xi Wang, Xu Tan, Lei He

Stochastic Pitch Prediction Improves the Diversity and Naturalness of Speech in Glow-TTS

Sewade Ogun, Vincent Colotte, Emmanuel Vincent

EE-TTS: Emphatic Expressive TTS with Linguistic Information

Yi Zhong, Chen Zhang, Xule Liu, Chenxi Sun, Weishan Deng

LightClone: Speaker-guided Parallel Subnet Selection for Few-shot Voice Cloning

Jie Wu, Jian Luan, Yujun Wang

Prosody Modeling with 3D Visual Information for Expressive Video Dubbing

Zhihan Yang, Shansong Liu, Xu Li, Haozhe Wu, Zhiyong Wu

Diverse and Expressive Speech Prosody Prediction with Denoising Diffusion Probabilistic Model

Xiang Li, Songxiang Liu, Max W. Y. Lam, Zhiyong Wu, Chao Weng

A Neural TTS System with Parallel Prosody Transfer from Unseen Speakers

Slava Shechtman, Raul Fernandez

Accentor: An Explicit Lexical Stress Model for TTS Systems

Diana Geneva, Georgi Shopov, Kostadin Garov, Maria Todorova, Stefan Gerdjikov

Synthesis after a couple PINTs: Investigating the Role of Pause-Internal Phonetic Particles in Speech Synthesis and Perception

Mikey Elmers, Johannah O'Mahony, Eva Szekely

Cross-lingual Prosody Transfer for Expressive Machine Dubbing

Jakub Swiatkowski, Duo Wang, Mikolaj Babianski, Patrick Lumban Tobing, Ravichander Vipperla

Neural Speech Synthesis with Enriched Phrase Boundaries

Marie Kunešová, Jindřich Matoušek

ComedicSpeech: Text To Speech For Stand-up Comedies in Low-Resource Scenarios

Yuyue Wang, Huan Xiao, Yihan Wu, Ruihua Song

Expresso: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis

Tu Anh Nguyen, Wei-Ning Hsu, Antony D'Avirro, Bowen Shi, Itai Gat

Semi-supervised Learning for Continuous Emotional Intensity Controllable Speech Synthesis with Disentangled Representations

Yoori Oh, Juheon Lee, Yoseob Han, Kyogu Lee

CASEIN: Cascading Explicit and Implicit Control for Fine-grained Emotion Intensity Regulation

Yuhao Cui, Xiongwei Wang, Zhongzhou Zhao, Wei Zhou, Haiqing Chen

Narrator or Character: Voice Modulation in an Expressive Multi-speaker TTS

Tankala Pavan Kalyan, Preeti Rao, Preethi Jyothi, Pushpak Bhattacharyya

MaskedSpeech: Context-aware Speech Synthesis with Masking Strategy

Ya-Jie Zhang, Wei Song, Yanghao Yue, Zhengchen Zhang, Youzheng Wu

NoreSpeech: Knowledge Distillation based Conditional Diffusion Model for Noise-robust Expressive TTS

Dongchao Yang, Songxiang Liu, Helin Wang, Jianwei Yu, Chao Weng

Dual Audio Encoders Based Mandarin Prosodic Boundary Prediction by Using Multi-Granularity Prosodic Representations

Ruishan Li, Yingming Gao, Yanlu Xie, Dengfeng Ke, Jinsong Zhang

Controllable Generation of Artificial Speaker Embeddings through Discovery of Principal Directions

Florian Lux, Pascal Tilli, Sarina Meyer, Ngoc Thang Vu

Speech Enhancement Patterns in Human-Robot Interaction: A Cross-Linguistic Perspective

Jacek Kudera, Katharina Zahner-Ritter, Jakob Engel, Nathalie Elsässer, Philipp Hutmacher

Pitch distributions in a very large corpus of spontaneous Finnish speech

Mietta Lennes, Minnaleena Toivola

Vowel reduction by Greek-speaking children: The effect of stress and word length

Polychronia Christodoulidou, Katerina Nicolaidis, Dimitrios Stamovlasis

(Dis)agreement and Preference Structure are Reflected in Matching Along Distinct Acoustic-prosodic Features

Anneliese Kelterer, Margaret Zellers, Barbara Schuppler

Rhythmic Characteristics of L2 German Speech by Advanced Chinese Learners

Lindun Ge, Min Xu, Hongwei Ding

Mapping Phonemes to Acoustic Symbols and Codes Using Synchrony in Speech Modulation Vectors Estimated by the Travellingwave Filter Bank

Ashwin Rao

Durational and Non-durational Correlates of Lexical and Derived Geminates in Arabic

Amel Issa

Effects of Tonal Coarticulation and Prosodic Positions on Tonal Contours of Low Rising Tones: In the Case of Xiamen Dialect

Yiying Hu, Hui Feng, Qinghua Zhao, Aijun Li

Speaker-independent Speech Inversion for Estimation of Nasalance

Yashish M Siriwardena, Carol Espy-Wilson, Suzanne Boyce, Mark Tiede, Liran Oren

A System for Generating Voice Source Signals that Implements the Transformed LF-model Parameter Control

Zihan Wang, Christer Gobl

Discovering Phonetic Feature Event Patterns in Transformer Embeddings

Patrick Cormac English, John D. Kelleher, Julie Carson-berndsen

Same F0, Different Tones: A Multidimensional Investigation of Zhangzhou Tones

Yishan Huang

Using speech synthesis to explain automatic speaker recognition: a new application of synthetic speech

Georgina Brown, Christin Kirchhübel, Ramiz Cuthbert

Coarticulation of Sibe Vowels and Dorsal Fricatives in Spontaneous Speech: An Acoustic Study

Jared Sharp, Matthew Faytak, Hasutai Fei Xiong Liu

Nonbinary American English speakers encode gender in vowel acoustics

Maxwell Hope, Charlotte Ward, Jason Lilley

Experimenting with Additive Margins for Contrastive Self-Supervised Speaker Verification

Theo Lepage, Reda Dehak

A Teacher-Student Approach for Extracting Informative Speaker Embeddings From Speech Mixtures

Tobias Cord-Landwehr, Christoph Boeddeker, Cătălin Zorilă, Rama Doddipatla, Reinhold Haeb-Umbach

Introducing Self-Supervised Phonetic Information for Text-Independent Speaker Verification

Ziyang Zhang, Wu Guo, Bin Gu

Curriculum Learning for Self-supervised Speaker Verification

Hee-soo Heo, Jee-weon Jung, Jingu Kang, Young-ki Kwon, Bong-Jin Lee

Self-FiLM: Conditioning GANs with self-supervised representations for bandwidth extension based speaker recognition

Saurabh Kataria, Jesus Villalba, Laureano Moro-Velazquez, Thomas Thebaud, Najim Dehak

Ordered and Binary Speaker Embedding

Jiaying Wang, Xianglong Wang, Namin Wang, Lantian Li, Dong Wang

Tracking Must Go On : Dialogue State Tracking with Verified Self-Training

Jihyun Lee, Chaebin Lee, Yunsu Kim, Gary Geunbae Lee

Knowledge-Retrieval Task-Oriented Dialog Systems with Semi-Supervision

Yucheng Cai, Hong Liu, Zhijian Ou, Yi Huang, Junlan Feng

Speech Aware Dialog System Technology Challenge (DSTC11)

Hagen Soltau, Izhak Shafran, Mingqiu Wang, Abhinav Rastogi, Jeffrey Zhao

Style-transfer based Speech and Audio-visual Scene understanding for Robot Action Sequence Acquisition from Videos

Chiori Hori, Puyuan Peng, David Harwath, Xinyu Liu, Kei Ota

An Autoregressive Conversational Dynamics Model for Dialogue Systems

Matthew McNeill, Rivka Levitan

Parameter-Efficient Low-Resource Dialogue State Tracking by Prompt Tuning

Mingyu Derek Ma, Jiun-Yu Kao, Shuyang Gao, Arpit Gupta, Di Jin

Influence of Utterance and Speaker Characteristics on the Classification of Children with Cleft Lip and Palate

Ilja Baumann, Dominik Wagner, Franziska Braun, Sebastian P. Bayerl, Elmar Nöth

A Study on Using Duration and Formant Features in Automatic Detection of Speech Sound Disorder in Children

Si-Ioi Ng, Cymie Wing-Yee Ng, Tan Lee

Measuring Phonological Precision in Children with Cleft Lip and Palate

Tomás Arias-Vergara, Elizabeth Londoño-Mora, Paula A. Pérez-Toro, Maria Schuster, Elmar Nöth

Understanding Spoken Language Development of Children with ASD Using Pre-trained Speech Embeddings

Anfeng Xu, Rajat Hebbar, Rimita Lahiri, Tiantian Feng, Lindsay Butler

Speech Breathing Behavior During Pauses in Children

Delphine Charuau, Béatrice Vaxelaire, Rudolph Sock

Speaking Clearly, Understanding Better: Predicting the L2 Narrative Comprehension of Chinese Bilingual Kindergarten Children Based on Speech Intelligibility Using a Machine Learning Approach

Hiuching Hung, Paula A. Pérez-Toro, Tomás Arias-Vergara, Andreas Maier, Elmar Nöth

Measuring Language Development From Child-centered Recordings

Yaya Sy, William N. Havard, Marvin Lavechin, Emmanuel Dupoux, Alejandrina Cristia

An Analysis of Goodness of Pronunciation for Child Speech

Xinwei Cao, Zijian Fan, Torbjørn Svendsen, Giampiero Salvi

An Equitable Framework for Automatically Assessing Children's Oral Narrative Language Abilities

Alexander Johnson, Hariram Veeramani, Natarajan Balaji Shankar, Abeer Alwan

Automatically Predicting Perceived Conversation Quality in a Pediatric Sample Enriched for Autism

Yahan Yang, Sunghye Cho, Maxine Covello, Azia Knox, Osbert Bastani