Interspeech 2023

1,141 papers

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Huiqiang Jiang, Li Lyna Zhang, Yuang Li, Yu Wu, Shijie Cao

Streaming Speech-to-Confusion Network Speech Recognition

Denis Filimonov, Prabhat Pandey, Ariya Rastrow, Ankur Gandhe, Andreas Stolcke

RASR2: The RWTH ASR Toolkit for Generic Sequence-to-sequence Speech Recognition

Wei Zhou, Eugen Beck, Simon Berger, Ralf Schlüter, Hermann Ney

Another Point of View on Visual Speech Recognition

Baptiste Pouthier, Laurent Pilati, Giacomo Valenti, Charles Bouveyron, Frederic Precioso

Distillation Strategies for Discriminative Speech Recognition Rescoring

Prashanth Gurunath Shivakumar, Jari Kolehmainen, Yile Gu, Ankur Gandhe, Ariya Rastrow

A Metric-Driven Approach to Conformer Layer Pruning for Efficient ASR Inference

Dhanush Bekal, Karthik Gopalakrishnan, Karel Mundnich, Srikanth Ronanki, Sravan Bodapati

HK-LegiCoST: Leveraging Non-Verbatim Transcripts for Speech Translation

Cihan Xiao, Henry Li Xinyuan, Jinyi Yang, Dongji Gao, Matthew Wiesner

Thai Dialect Corpus and Transfer-based Curriculum Learning Investigation for Dialect Automatic Speech Recognition

Artit Suwanbandit, Burin Naowarat, Orathai Sangpetch, Ekapol Chuangsuwanich

MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation

Mohamed Anwar, Bowen Shi, Vedanuj Goswami, Wei-Ning Hsu, Juan Pino

MD3: The Multi-Dialect Dataset of Dialogues

Jacob Eisenstein, Vinodkumar Prabhakaran, Clara Rivera, Dorottya Demszky, Devyani Sharma

MOCKS 1.0: Multilingual Open Custom Keyword Spotting Testset

Mikołaj Pudo, Mateusz Wosik, Adam Cieślak, Justyna Krzywdziak, Bozena Lukasiak

Multimodal Personality Traits Assessment (MuPTA) Corpus: The Impact of Spontaneous and Read Speech

Elena Ryumina, Dmitry Ryumin, Maxim Markitantov, Heysem Kaya, Alexey Karpov

Gesper: A Restoration-Enhancement Framework for General Speech Reconstruction

Wenzhe Liu, Yupeng Shi, Jun Chen, Wei Rao, Shulin He

Causal Signal-Based DCCRN with Overlapped-Frame Prediction for Online Speech Enhancement

Julitta Bartolewska, Stanisław Kacprzak, Konrad Kowalczyk

MC-SpEx: Towards Effective Speaker Extraction with Multi-Scale Interfusion and Conditional Speaker Modulation

Jun Chen, Wei Rao, Zilin Wang, Jiuxin Lin, Yukai Ju

UnSE: Unsupervised Speech Enhancement Using Optimal Transport

Wenbin Jiang, Fei Wen, Yifan Zhang, Kai Yu

Extending DNN-based Multiplicative Masking to Deep Subband Filtering for Improved Dereverberation

Jean-Marie Lemercier, Julian Tobergte, Timo Gerkmann

On Training a Neural Residual Acoustic Echo Suppressor for Improved ASR

Sankaran Panchapagesan, Turaj Zakizadeh Shabestary, Arun Narayanan

DoubleDeceiver: Deceiving the Speaker Verification System Protected by Spoofing Countermeasures

Mengao Zhang, Ke Xu, Hao Li, Lei Wang, Chengfang Fang

Improved DeepFake Detection Using Whisper Features

Piotr Kawa, Marcin Plata, Michał Czuba, Piotr Szymański, Piotr Syga

Robust Audio Anti-spoofing Countermeasure with Joint Training of Front-end and Back-end Models

Xingming Wang, Bang Zeng, Suo Hongbin, Yulong Wan, Ming Li

Betray Oneself: A Novel Audio DeepFake Detection Model via Mono-to-Stereo Conversion

Rui Liu, Jinhua Zhang, Guanglai Gao, Haizhou Li

Pseudo-Siamese Network based Timbre-reserved Black-box Adversarial Attack in Speaker Identification

Qing Wang, Jixun Yao, Ziqian Wang, Pengcheng Guo, Lei Xie

Towards Single Integrated Spoofing-aware Speaker Verification Embeddings

Sung Hwan Mun, Hye-jin Shim, Hemlata Tak, Xin Wang, Xuechen Liu

Zambezi Voice: A Multilingual Speech Corpus for Zambian Languages

Claytone Sikasote, Kalinda Siaminwe, Stanly Mwape, Bangiwe Zulu, Mofya Phiri

Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff

Peter Polák, Brian Yan, Shinji Watanabe, Alex Waibel, Ondřej Bojar

AlignAtt: Using Attention-based Audio-Translation Alignments as a Guide for Simultaneous Speech Translation

Sara Papi, Marco Turchi, Matteo Negri

Mix before Align: Towards Zero-shot Cross-lingual Sentiment Analysis via Soft-Mix and Multi-View Learning

Zhihong Zhu, Xuxin Cheng, Dongsheng Chen, Zhiqi Huang, Hongxiang Li

PhonMatchNet: Phoneme-Guided Zero-Shot Keyword Spotting for User-Defined Keywords

Yong-Hyeok Lee, Namhyun Cho

Efficient Adaptation of Spoken Language Understanding based on End-to-End Automatic Speech Recognition

Eesung Kim, Aditya Jajodia, Cindy Tseng, Divya Neelagiri, Taeyeon Ki

Low-Resource Cross-Lingual Adaptive Training for Nigerian Pidgin

Pin-Jie Lin, Muhammed Saeed, Ernie Chang, Merel Scholman

Take the Hint: Improving Arabic Diacritization with Partially-Diacritized Text

Parnia Bahar, Mattia Di Gangi, Nick Rossenbach, Mohammad Zeineldeen

Diverse Feature Mapping and Fusion via Multitask Learning for Multilingual Speech Emotion Recognition

Shi-wook Lee

An Efficient Approach for the Automated Segmentation and Transcription of the People's Speech Sorpus

Astik Biswas, Abdelmoumene Boumadane, Stéphane Peillon, Gildas Bleas

Investigating Reproducibility at Interspeech Conferences: A Longitudinal and Comparative Perspective

Mohammad Arvan, A. Seza Doğruöz, Natalie Parde

AdaMS: Deep Metric Learning with Adaptive Margin and Adaptive Scale for Acoustic Word Discrimination

Myunghun Jung, Hoirin Kim

Joint Time and Frequency Transformer for Chinese Opera Classification

Qiang Li, Beibei Hu

Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken Language Understanding

Yi Xuan Tan, Navonil Majumder, Soujanya Poria

Model-assisted Lexical Tone Evaluation of three-year-old Chinese-speaking Children by also Considering Segment Production

Shu-Chuan Tseng, Yi-Fen Liu, Xiang-Li Lu

PATCorrect: Non-autoregressive Phoneme-augmented Transformer for ASR Error Correction

Ziji Zhang, Zhehui Wang, Rajesh Kamma, Sharanya Eswaran, Narayanan Sadagopan

How Does Pretraining Improve Discourse-Aware Translation?

Zhihong Huang, Longyue Wang, Siyou Liu, Derek F. Wong

Harmonic enhancement using learnable comb filter for light-weight full-band speech enhancement model

Xiaohuai Le, Tong Lei, Li Chen, Yiqing Guo, Chao He

Rethinking Complex-Valued Deep Neural Networks for Monaural Speech Enhancement

Haibin Wu, Ke Tan, Buye Xu, Anurag Kumar, Daniel Wong

FRA-RIR: Fast Random Approximation of the Image-source Method

Yi Luo, Jianwei Yu

DNN-based Parameter Estimation for MVDR Beamforming and Post-filtering

Minseung Kim, Sein Cheong, Jong Won Shin

Aligning Speech Enhancement for Improving Downstream Classification Performance

Yan Xiong, Visar Berisha, Chaitali Chakrabarti

Deep Multi-Frame Filtering for Hearing Aids

Hendrik Schröter, Tobias Rosenkranz, Alberto N. Escalante-B., Andreas Maier

Weighted Von Mises Distribution-based Loss Function for Real-time STFT Phase Reconstruction Using DNN

Nguyen Binh Thien, Yukoh Wakabayashi, Yuting Geng, Kenta Iwai, Takanobu Nishiura

Personalized Dereverberation of Speech

Ruilin Xu, Gurunandan Krishnan, Changxi Zheng, Shree K. Nayar

Two-Stage Voice Anonymization for Enhanced Privacy

Francesco Nespoli, Daniel Barreda, Jöerg Bitzer, Patrick A. Naylor

Self-supervised learning with Diffusion-based multichannel speech enhancement for speaker verification under noisy conditions

Sandipana Dowerah, Ajinkya Kulkarni, Romain Serizel, Denis Jouvet

Detection of Cross-Dataset Fake Audio Based on Prosodic and Pronunciation Features

Chenglong Wang, Jiangyan Yi, Jianhua Tao, Chu Yuan Zhang, SHUAI ZHANG

TridentSE: Guiding Speech Enhancement with 32 Global Tokens

Dacheng Yin, Zhiyuan Zhao, Chuanxin Tang, Zhiwei Xiong, Chong Luo

MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectra

Ye-Xin Lu, Yang Ai, Zhen-Hua Ling

HD-DEMUCS: General Speech Restoration with Heterogeneous Decoders

Doyeon Kim, Soo-Whan Chung, Hyewon Han, Youna Ji, Hong-Goo Kang

Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancement

Ryosuke Sawata, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Takashi Shibuya

DeepVQE: Real Time Deep Voice Quality Enhancement for Joint Acoustic Echo Cancellation, Noise Suppression and Dereverberation

Nicolae Catalin Ristea, Evgenii Indenbom, Ando Saabas, Tanel Parnamaa, Jegor Guzhvin

Complex-valued neural networks for voice anti-spoofing

Nicolas M. Müller, Philip Sperl, Konstantin Böttinger

Reducing the Prior Mismatch of Stochastic Differential Equations for Diffusion-based Speech Enhancement

Bunlong Lay, Simon Welker, Julius Richter, Timo Gerkmann

Multi-Dataset Co-Training with Sharpness-Aware Optimization for Audio Anti-spoofing

Hye-jin Shim, Jee-weon Jung, Tomi Kinnunen

Ontology-aware Learning and Evaluation for Audio Tagging

Haohe Liu, Qiuqiang Kong, Xubo Liu, Xinhao Mei, Wenwu Wang

Monaural Speech Separation Method Based on Recurrent Attention with Parallel Branches

Xue Yang, Changchun Bao, Xu Zhang, Xianhong Chen

Locate and Beamform: Two-dimensional Locating All-neural Beamformer for Multi-channel Speech Separation

Yanjie Fu, Meng Ge, Honglong Wang, Nan Li, Haoran Yin

A Neural State-Space Modeling Approach to Efficient Speech Separation

Chen Chen, Chao-Han Huck Yang, Kai Li, Yuchen Hu, Pin-Jui Ku

FN-SSL: Full-Band and Narrow-Band Fusion for Sound Source Localization

Yabo Wang, Bing Yang, Xiaofei Li

Dual-Memory Multi-Modal Learning for Continual Spoken Keyword Spotting with Confidence Selection and Diversity Enhancement

Zhao Yang, Dianwen Ng, Xizhe Li, Chong Zhang, Rui Jiang

SR-SRP: Super-Resolution based SRP-PHAT for Sound Source Localization and Tracking

Jae-Heung Cho, Joon-Hyuk Chang

Investigation of Training Mute-Expressive End-to-End Speech Separation Networks for an Unknown Number of Speakers

Younggwan Kim, Hyungjun Lim, Kiho Yeom, Eunjoo Seo, Hoodong Lee

Using Semi-supervised Learning for Monaural Time-domain Speech Separation with a Self-supervised Learning-based SI-SNR Estimator

Shaoxiang Dang, Tetsuya Matsumoto, Yoshinori Takeuchi, Hiroaki Kudo

Rethinking the Visual Cues in Audio-Visual Speaker Extraction

Junjie Li, Meng Ge, Zexu Pan, Rui Cao, Longbiao Wang

Multi-channel separation of dynamic speech and sound events

Takuya Fujimura, Robin Scheibler

Deeply Supervised Curriculum Learning for Deep Neural Network-based Sound Source Localization

Min-Sang Baek, Joon-Young Yang, Joon-Hyuk Chang

SDNet: Stream-attention and Dual-feature Learning Network for Ad-hoc Array Speech Separation

Honglong Wang, Chengyun Deng, Yanjie Fu, Meng Ge, Longbiao Wang

Joint Blind Source Separation and Dereverberation for Automatic Speech Recognition using Delayed-Subsource MNMF with Localization Prior

Mieszko Fraś, Marcin Witkowski, Konrad Kowalczyk

Image-driven Audio-visual Universal Source Separation

Chenxing Li, Ye Bai, Yang Wang, Feng Deng, Yuanyuan Zhao

Spatial LibriSpeech: An Augmented Dataset for Spatial Audio Learning

Miguel Sarabia, Elena Menyaylenko, Alessandro Toso, Skyler Seto, Zakaria Aldeneh

PIAVE: A Pose-Invariant Audio-Visual Speaker Extraction Network

Qinghua Liu, Meng Ge, Zhizheng Wu, Haizhou Li

Speaker Extraction with Detection of Presence and Absence of Target Speakers

Ke ZHANG, Marvin Borsdorf, Zexu Pan, Haizhou Li, Yangjie Wei

Contrastive Learning based Deep Latent Masking for Music Source Separation

Jihyun Kim, Hong-Goo Kang

Binaural Sound Localization in Noisy Environments Using Frequency-Based Audio Vision Transformer (FAViT)

Waradon Phokhinanan, Nicolas Obin, Sylvain Argentieri

An Efficient Speech Separation Network Based on Recurrent Fusion Dilated Convolution and Channel Attention

Junyu Wang

Audio-Visual Fusion using Multiscale Temporal Convolutional Attention for Time-Domain Speech Separation

Debang Liu, Tianqi Zhang, Mads Græsbøll Christensen, Ying Wei, Zeliang An

Time-frequency Domain Filter-and-sum Network for Multi-channel Speech Separation

Zhewen Deng, Yi Zhou, Hongqing Liu

Personal Primer Prototype 1: Invitation to Make Your Own Embooked Speech-Based Educational Artifact

Daniel D. Hromada, Hyungjoong Kim

MyVoice: Arabic Speech Resource Collaboration Platform

Yousseif Elshahawy, Yassine El Kheir, Shammur Absar Chowdhury, Ahmed M. Ali

Technology Pipeline for Large Scale Cross-Lingual Dubbing of Lecture Videos into Multiple Indian Languages

Anusha Prakash, Arun Kumar, Ashish Seth, Bhagyashree Mukherjee, Ishika Gupta

DisfluencyFixer: A tool to enhance Language Learning through Speech To Speech Disfluency Correction

Vineet Bhat, Preethi Jyothi, Pushpak Bhattacharyya

Asking Questions: an Innovative Way to Interact with Oral History Archives

Jan Švec, Martin Bulín, Adam Frémund, Filip Polák

QVoice: Arabic Speech Pronunciation Learning Application

Yassine El Kheir, Fouad Khnaisser, Shammur Absar Chowdhury, Hamdy Mubarak, Shazia Afzal

Large-Scale Automatic Audiobook Creation

Brendan Walsh, Mark Hamilton, Greg Newby, Xi Wang, Serena Ruan

Teaching Non-native Sound Contrasts using Visual Biofeedback

Shawn Nissen

Measuring prosody in child speech using SoapBox Fluency API

Mauro Nicolao, Brenda McGuirk, Declan Moore, Niall Mullally, Lora Lynn O’Mahony

Speak & Improve: L2 English Speaking Practice Tool

Diane Nicholls, Kate M. Knill, Mark J. F. Gales, Anton Ragni, Paul Ricketts

A Unified Framework to Improve Learners' Skills of Perception and Production Based on Speech Shadowing and Overlapping

Nobuaki Minematsu, Noriko Nakanishi, Yingxiang Gao, Haitong Sun

A Study on Prosodic Entrainment in Relation to Therapist Empathy in Counseling Conversation

Dehua Tao, Tan Lee, Harold Chui, Sarah Luk

Distant Speech Emotion Recognition in an Indoor Human-robot Interaction Scenario

Nicolás Grágeda, Eduardo Alvarado, Rodrigo Mahu, Carlos Busso, Néstor Becerra Yoma

Multi-Scale Temporal Transformer For Speech Emotion Recognition

Zhipeng Li, Xiaofen Xing, Yuanbo Fang, Weibin Zhang, Hengsheng Fan

A novel frequency warping scale for speech emotion recognition

Premjeet Singh, Goutam Saha

Investigating Acoustic Cues for Multilingual Abuse Detection

Yash Thakran, Vinayak Abrol

Two-stage Finetuning of Wav2vec 2.0 for Speech Emotion Recognition with ASR and Gender Pretraining

Yuan Gao, Chenhui Chu, Tatsuya Kawahara