Interspeech 2023

1,141 papers

Diff-E: Diffusion-based Learning for Decoding Imagined Speech EEG

Soowon Kim, Young-Eun Lee, Seo-Hyun Lee, Seong-Whan Lee

Auditory Attention Detection in Real-Life Scenarios Using Common Spatial Patterns from EEG

Kai Yang, Zhuang Xie, Di Zhou, Longbiao Wang, Gaoyan Zhang

Silent Speech Recognition with Articulator Positions Estimated from Tongue Ultrasound and Lip Video

Rachel Beeson, Korin Richmond

EEG-based Auditory Attention Detection with Spatiotemporal Graph and Graph Convolutional Network

Ruicong Wang, Siqi Cai, Haizhou Li

Obstructive Sleep Apnea Detection using Pre-trained Speech Representations

Kaibo Zhang, Lili Cao, Yiming Ding, Yanru Li, Chao Zhang

GhostT5: Generate More Features with Cheap Operations to Improve Textless Spoken Question Answering

Xuxin Cheng, Zhihong Zhu, Ziyu Yao, Hongxiang Li, Yaowei Li

ConvKT: Conversation-Level Knowledge Transfer for Context Aware End-to-End Spoken Language Understanding

Vishal Sunder, Eric Fosler-Lussier, Samuel Thomas, Hong-Kwang J Kuo, Brian Kingsbury

Cross-Modal Semantic Alignment before Fusion for Two-Pass End-to-End Spoken Language Understanding

Lingyan Huang, Tao Li, Haodong Zhou, Qingyang Hong, Lin Li

Modality Confidence Aware Training for Robust End-to-End Spoken Language Understanding

Suyoun Kim, Akshat Shrivastava, Duc Le, Ju Lin, Ozlem Kalinli

Improving End-to-End SLU performance with Prosodic Attention and Distillation

Shangeth Rajaa

Can ChatGPT Detect Intent? Evaluating Large Language Models for Spoken Language Understanding

Mutian He, Philip N. Garner

Investigating Range-Equalizing Bias in Mean Opinion Score Ratings of Synthesized Speech

Erica Cooper, Junichi Yamagishi

Can Better Perception Become a Disadvantage? Synthetic Speech Perception in Congenitally Blind Users

Gerda Ana Melnik-Leroy, Gediminas Navickas

RAMP: Retrieval-Augmented MOS Prediction via Confidence-based Dynamic Weighting

Hui Wang, Shiwan Zhao, Xiguang Zheng, Yong Qin

MOS vs. AB: Evaluating Text-to-Speech Systems Reliably Using Clustered Standard Errors

Joshua Camp, Tom Kenter, Lev Finkelstein, Rob Clark

How Generative Spoken Language Modeling Encodes Noisy Speech: Investigation from Phonetics to Syntactics

Joonyong Park, Shinnosuke Takamichi, Tomohiko Nakamura, Kentaro Seki, Detai Xin

Listener sensitivity to deviating obstruents in WaveNet

Ayushi Pandey, Jens Edlund, Sébastien Le Maguer, Naomi Harte

Short-term Extrapolation of Speech Signals Using Recursive Neural Networks in the STFT Domain

Maurice Oberhag, Daniel Neudek, Rainer Martin, Tobias Rosenkranz, Henning Puder

Multi-input Multi-output Complex Spectral Mapping for Speaker Separation

Hassan Taherian, Ashutosh Pandey, Daniel Wong, Buye Xu, Deliang Wang

Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancement

Zilu Guo, Jun Du, Chin-Hui Lee, Yu Gao, Wenbin Zhang

MFT-CRN:Multi-scale Fourier Transform for Monaural Speech Enhancement

Yulong Wang, Xueliang Zhang

TaylorBeamixer: Learning Taylor-Inspired All-Neural Multi-Channel Speech Enhancement from Beam-Space Dictionary Perspective

Andong Li, Weixin Meng, Guochen Yu, Wenzhe Liu, Xiaodong Li

Real-Time Joint Personalized Speech Enhancement and Acoustic Echo Cancellation

Sefik Emre Eskimez, Takuya Yoshioka, Alex Ju, Min Tang, Tanel Parnamaa

Multiple Instance Learning for Inference of Child Attachment From Paralinguistic Aspects of Speech

Areej Buker, Huda Alsofyani, Alessandro Vinciarelli

Cues to next-speaker projection in conversational Swedish: Evidence from reaction times

Kathrin Feindt, Martina Rossi, Ghazaleh Esfandiari-Baiat, Axel G. Ekström, Margaret Zellers

Towards Robust Family-Infant Audio Analysis Based on Unsupervised Pretraining of Wav2vec 2.0 on Large-Scale Unlabeled Family Audio

Jialu Li, Mark Hasegawa-Johnson, Nancy L. McElwain

Capturing Formality in Speech Across Domains and Languages

Debasmita Bhattacharya, Jie Chi, Julia Hirschberg, Peter Bell

Detection of Laughter and Screaming Using the Attention and CTC Models

Takuto Matsuda, Yoshiko Arimoto

Detection of Emotional Hotspots in Meetings Using a Cross-Corpus Approach

Georg Stemmer, Paulo Lopez Meyer, Juan Del Hoyo Ontiveros, Jose Lopez, Hector A. Cordourier

Beyond the AI hype: Balancing Innovation and Social Responsibility

Virginia Dignum

Mispronunciation detection and diagnosis model for tonal language, applied to Vietnamese

Tuong Tu Huu, Viet Thanh Pham, Thi Thu Trang NGUYEN, Thai Lai Dao

Zero-Shot Automatic Pronunciation Assessment

Hongfu Liu, Mingqian Shi, Ye Wang

Orthography-based Pronunciation Scoring for Better CAPT Feedback

Caitlin Richter, Ragnar Pálsson, Luke O'Brien, Kolbrún Friðriksdóttir, Branislav Bédi

Improving grapheme-to-phoneme conversion by learning pronunciations from speech recordings

Sam Ribeiro, Giulia Comini, Jaime Lorenzo-Trueba

Addressing Cold Start Problem for End-to-end Automatic Speech Scoring

Jungbae Park, Seungtaek Choi

Adapting an Unadaptable ASR System

Rao Ma, Mengjie Qian, Mark J. F. Gales, Kate M. Knill

Assessment of Non-Native Speech Intelligibility using Wav2vec2-based Mispronunciation Detection and Multi-level Goodness of Pronunciation Transformer

Ram C. M. C. Shekar, Mu Yang, Kevin Hirschi, Stephen Looney, Okim Kang

Automatic Prediction of Language Learners' Listenability Using Speech and Text Features Extracted from Listening Drills

Yingxiang Gao, Jaehyun Choi, Nobuaki Minematsu, Noriko Nakanishi, Daisuke Saito

A Hierarchical Context-aware Modeling Approach for Multi-aspect and Multi-granular Pronunciation Assessment

Fu-An Chao, Tien-Hong Lo, Tzu-I Wu, Yao-Ting Sung, Berlin Chen

End-to-End Word-Level Pronunciation Assessment with MASK Pre-training

Yukang Liang, Kaitao Song, Shaoguang Mao, Huiqiang Jiang, Luna Qiu

Assessing Intelligibility in Non-native Speech: Comparing Measures Obtained at Different Levels

Xing Wei, Roeland van Hout, Catia Cucchiarini, Danielle Reuvekamp, Helmer Strik

A Joint Model for Pronunciation Assessment and Mispronunciation Detection and Diagnosis with Multi-task Learning

Hyungshin Ryu, Sunhee Kim, Minhwa Chung

Disentangling the Contribution of Non-native Speech in Automated Pronunciation Assessment

Shuju Shi, Kaiqi Fu, Yiwei Gu, Xiaohai Tian, Shaojun Gao

Phonetic and Prosody-aware Self-supervised Learning Approach for Non-native Fluency Scoring

Kaiqi Fu, Shaojun Gao, Shuju Shi, Xiaohai Tian, Wei Li

Rehearsal-Free Online Continual Learning for Automatic Speech Recognition

Steven Vander Eeckt, Hugo Van hamme

Approximate Nearest Neighbour Phrase Mining for Contextual Speech Recognition

Maurits Bleeker, Pawel Swietojanski, Stefan Braun, Xiaodan Zhuang

OTF: Optimal Transport based Fusion of Supervised and Self-Supervised Learning Models for Automatic Speech Recognition

Li Fu, Siqi Li, Qingtao Li, Fangzhu Li, Liping Deng

DCCRN-KWS: An Audio Bias Based Model for Noise Robust Small-Footprint Keyword Spotting

Shubo Lv, Xiong Wang, Sining Sun, Long Ma, Lei Xie

Bypass Temporal Classification: Weakly Supervised Automatic Speech Recognition with Imperfect Transcripts

Dongji Gao, Matthew Wiesner, Hainan Xu, Leibny Paola Garcia, Daniel Povey

Improving Code-Switching and Name Entity Recognition in ASR with Speech Editing based Data Augmentation

Zheng Liang, Zheshu Song, Ziyang Ma, Chenpeng Du, Kai Yu

Rethinking Speech Recognition with A Multimodal Perspective via Acoustic and Semantic Cooperative Decoding

Tian-Hao Zhang, Hai-Bo Qin, Zhi-Hao Lai, Song-Lu Chen, Qi Liu

Adapter Incremental Continual Learning of Efficient Audio Spectrogram Transformers

Nithish Muthuchamy Selvaraj, Xiaobao Guo, Adams Kong, Bingquan Shen, Alex Kot

Random Utterance Concatenation Based Data Augmentation for Improving Short-video Speech Recognition

Yist Y. Lin, Tao Han, Haihua Xu, Van Tung Pham, Yerbolat Khassanov

Knowledge Distillation for Neural Transducer-based Target-Speaker ASR: Exploiting Parallel Mixture/Single-Talker Speech Data

Takafumi Moriya, Hiroshi Sato, Tsubasa Ochiai, Marc Delcroix, Takanori Ashihara

Joint Instance Reconstruction and Feature Subspace Alignment for Cross-Domain Speech Emotion Recognition

Keke Zhao, Peng Song, Shaokai Li, Wenming Zheng

General-purpose Adversarial Training for Enhanced Automatic Speech Recognition Model Generalization

Dohee Kim, Daeyeol Shim, Joon-Hyuk Chang

ML-SUPERB: Multilingual Speech Universal PERformance Benchmark

Jiatong Shi, Dan Berrebbi, William Chen, En-Pei Hu, Wei-Ping Huang

Attention Gate Between Capsules in Fully Capsule-Network Speech Recognition

Kyungmin Lee, Hyeontaek Lim, Mun-Hwan Lee, Hong-Gee Kim

A More Accurate Internal Language Model Score Estimation for the Hybrid Autoregressive Transducer

Kyungmin Lee, Haeri Kim, Sichen Jin, Jinhwan Park, Youngho Han

DeFT-AN RT: Real-time Multichannel Speech Enhancement using Dense Frequency-Time Attentive Network and Non-overlapping Synthesis Window

Dongheon Lee, Dayun Choi, Jung-Woo Choi

Perceptual Improvement of Deep Neural Network (DNN) Speech Coder Using Parametric and Non-parametric Density Models

Joon Byun, Seungmin Shin, Jongmo Sung, Seungkwon Beack, Youngcheol Park

Downstream Task Agnostic Speech Enhancement with Self-Supervised Representation Loss

Hiroshi Sato, Ryo Masumura, Tsubasa Ochiai, Marc Delcroix, Takafumi Moriya

Consonant-emphasis Method Incorporating Robust Consonant-section Detection to Improve Intelligibility of Bone-conducted speech

Yasufumi Uezu, Sicheng Wang, Teruki Toya, Masashi Unoki

Incorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement through Knowledge Distillation

Rui-Chen Zheng, Yang Ai, Zhen-Hua Ling

Differentially Private Adapters for Parameter Efficient Acoustic Modeling

Chun-Wei Ho, Chao-Han Huck Yang, Sabato Marco Siniscalchi

Hybrid AHS: A Hybrid of Kalman Filter and Deep Learning for Acoustic Howling Suppression

Hao Zhang, Meng Yu, Yuzhong Wu, Tao Yu, Dong Yu

Sequence-to-Sequence Multi-Modal Speech In-Painting

Mahsa Kadkhodaei Elyaderani, Shahram Shirani

Streaming Dual-Path Transformer for Speech Enhancement

Soo Hyun Bae, Seok Wan Chae, Youngseok Kim, Keunsang Lee, Hyunjin Lim

Multi-mode Neural Speech Coding Based on Deep Generative Networks

Wei Xiao, Wenzhe Liu, Meng Wang, Shan Yang, Yupeng Shi

Feature Normalization for Fine-tuning Self-Supervised Models in Speech Enhancement

Hejung Yang, Hong-Goo Kang

CFTNet: Complex-valued Frequency Transformation Network for Speech Enhancement

Nursadul Mamun, John H. L. Hansen

Real-Time Personalised Speech Enhancement Transformers with Dynamic Cross-attended Speaker Representations

Shucong Zhang, Malcolm Chadwick, Alberto Gil C. P. Ramos, Titouan Parcollet, Rogier van Dalen

An Intra-BRNN and GB-RVQ Based END-TO-END Neural Audio Codec

Linping Xu, Jiawei Jiang, Dejun Zhang, Xianjun Xia, Li Chen

A Two-stage Progressive Neural Network for Acoustic Echo Cancellation

Zhuangqi Chen, Xianjun Xia, Cheng Chen, Xianke Wang, Yanhong Leng

CleanUNet 2: A Hybrid Speech Denoising Model on Waveform and Spectrogram

Zhifeng Kong, Wei Ping, Ambrish Dantrey, Bryan Catanzaro

How to Construct Perfect and Worse-than-Coin-Flip Spoofing Countermeasures: A Word of Warning on Shortcut Learning

Hye-jin Shim, Rosa Gonzalez Hautamäki, Md Sahidullah, Tomi Kinnunen

On-Device Speaker Anonymization of Acoustic Embeddings for ASR based on Flexible Location Gradient Reversal Layer

Md Asif Jalal, Pablo Peso Parada, Jisi Zhang, Mete Ozay, Karthikeyan Saravanan

Biophysically-inspired single-channel speech enhancement in the time domain

Chuan Wen, Sarah Verhulst

WhiSLU: End-to-End Spoken Language Understanding with Whisper

Minghan Wang, Yinglu Li, Jiaxin Guo, Xiaosong Qiao, Zongyao Li

Emotion Awareness in Multi-utterance Turn for Improving Emotion Prediction in Multi-Speaker Conversation

Xiaohan Shi, Xingfeng Li, Tomoki Toda

5IDER: Unified Query Rewriting for Steering, Intent Carryover, Disfluencies, Entity Carryover and Repair

Jiarui Lu, Bo-Hsiang Tseng, Joel Ruben Antony Moniz, Site Li, Xueyun Zhu

Sampling bias in NLU models: Impact and Mitigation

Zefei Li, Anil Ramakrishna, Anna Rumshisky, Andy Rosenbaum, Saleh Solta

Compositional Generalization in Spoken Language Understanding

Avik Ray, Yilin Shen, Hongxia Jin

Personalized Predictive ASR for Latency Reduction in Voice Assistants

Andreas Schwarz, Di He, Maarten Van Segbroeck, Mohammed Hethnawi, Ariya Rastrow

Enhancing New Intent Discovery via Robust Neighbor-based Contrastive Learning

Zhenhe Wu, Xiaoguang Yu, Meng Chen, Liangqing Wu, Jiahao Ji

An Investigation of the Combination of Rehearsal and Knowledge Distillation in Continual Learning for Spoken Language Understanding

Umberto Cappellazzo, Daniele Falavigna, Alessio Brutti

Unsupervised Dialogue Topic Segmentation in Hyperdimensional Space

Seongmin Park, Jinkyu Seo, Jihwa Lee

Contrastive Learning Based ASR Robust Knowledge Selection For Spoken Dialogue System

Zhiyuan Zhu, Yusheng Liao, Yu Wang, Yunfeng Guan

Integrating Pretrained ASR and LM to Perform Sequence Generation for Spoken Language Understanding

Siddhant Arora, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan

DiffSLU: Knowledge Distillation Based Diffusion Model for Cross-Lingual Spoken Language Understanding

Tianjun Mao, Chenghong Zhang

Tensor decomposition for minimization of E2E SLU model toward on-device processing

Yosuke Kashiwagi, Siddhant Arora, Hayato Futami, Jessica Huynh, Shih-Lun Wu

Semantic Enrichment Towards Efficient Speech Representations

Gaëlle Laperrière, Ha Nguyen, Sahar Ghannay, Bassam Jabaian, Yannick Estève

Tri-level Joint Natural Language Understanding for Multi-turn Conversational Datasets

Henry Weld, Sijia Hu, Siqu Long, Josiah Poon, Soyeon Han

C²A-SLU: Cross and Contrastive Attention for Improving ASR Robustness in Spoken Language Understanding

Xuxin Cheng, Ziyu Yao, Zhihong Zhu, Yaowei Li, Hongxiang Li

FC-MTLF: A Fine- and Coarse-grained Multi-Task Learning Framework for Cross-Lingual Spoken Language Understanding

Xuxin Cheng, Wanshi Xu, Ziyu Yao, Zhihong Zhu, Yaowei Li

Towards Two-point Neuron-inspired Energy-efficient Multimodal Open Master Hearing Aid

Mohsin Raza, Adewale Adetomi, Khubaib Ahmed, Amir Hussain, Tughrul Arslan

5G-IoT Cloud based Demonstration of Real-Time Audio-Visual Speech Enhancement for Multimodal Hearing-aids

Ankit Gupta, Abhijeet Bishnu, Mandar Gogate, Kia Dashtipour, Tughrul Arslan

Automated Neural Nursing Assistant (ANNA): An Over-The-Phone System for Cognitive Monitoring

Jacob Solinsky, Raymond Finzel, Martin Michalowski, Serguei Pakhomov

Providing Interpretable Insights for Neurological Speech and Cognitive Disorders from Interactive Serious Games

Mario Zusag, Laurin Wagner

Stuttering Detection Application

Kowshik Siva Sai Motepalli, Vamshiraghusimha Narasinga, Harsha Pathuri, Hina Khan, Sangeetha Mahesh