Interspeech 2022

1,123 papers

Evaluating the effects of modified speech on perceptual speaker identification performance

Benjamin O'Brien, Christine Meunier, Alain Ghio

Non-native Perception of Japanese Singleton/Geminate Contrasts: Comparison of Mandarin and Mongolian Speakers Differing in Japanese Experience

Kimiko Tsukada, Yurong Yurong

Perceptual Evaluation of Penetrating Voices through a Semantic Differential Method

Tatsuya Kitamura, Naoki Kunimoto, Hideki Kawahara, Shigeaki Amano

FeaRLESS: Feature Refinement Loss for Ensembling Self-Supervised Learning Features in Robust End-to-end Speech Recognition

Szu-Jui Chen, Jiamin Xie, John H.L. Hansen

Transfer Learning from Multi-Lingual Speech Translation Benefits Low-Resource Speech Recognition

Geoffroy Vanderreydt, François Remy, Kris Demuynck

On-demand compute reduction with stochastic wav2vec 2.0

Apoorv Vyas, Wei-Ning Hsu, Michael Auli, Alexei Baevski

Compute Cost Amortized Transformer for Streaming ASR

Yi Xie, Jonathan J. Macoskey, Martin Radfar, Feng-Ju Chang, Brian King

W2V2-Light: A Lightweight Version of Wav2vec 2.0 for Automatic Speech Recognition

Dong-Hyun Kim, Jae-Hong Lee, Ji-Hwan Mo, Joon-Hyuk Chang

Sub-8-Bit Quantization Aware Training for 8-Bit Neural Network Accelerator with On-Device Speech Recognition

Kai Zhen, Hieu Duy Nguyen, Raviteja Chinta, Nathan Susanj, Athanasios Mouchtaris

Reducing Domain mismatch in Self-supervised speech pre-training

Murali Karthick Baskar, Andrew Rosenberg, Bhuvana Ramabhadran, Yu Zhang, Nicolás Serrano

Deep residual spiking neural network for keyword spotting in low-resource settings

Qu Yang, Qi Liu, Haizhou Li

Cross-Speaker Emotion Transfer for Low-Resource Text-to-Speech Using Non-Parallel Voice Conversion with Pitch-Shift Data Augmentation

Ryo Terashima, Ryuichi Yamamoto, Eunwoo Song, Yuma Shirahata, Hyun-Wook Yoon

Leveraging Symmetrical Convolutional Transformer Networks for Speech to Singing Voice Style Transfer

Shrutina Agarwal, Naoya Takahashi, Sriram Ganapathy

Adversarial Multi-Task Learning for Disentangling Timbre and Pitch in Singing Voice Synthesis

Tae-Woo Kim, Min-Su Kang, Gyeong-Hoon Lee

A Unified System for Voice Cloning and Voice Conversion through Diffusion Probabilistic Modeling

Tasnima Sadekova, Vladimir Gogoryan, Ivan Vovk, Vadim Popov, Mikhail Kudinov

ACNN-VC: Utilizing Adaptive Convolution Neural Network for One-Shot Voice Conversion

Ji Sub Um, Yeunju Choi, Hoi Rin Kim

Karaoker: Alignment-free singing voice synthesis with speech training data

Panagiotis Kakoulidis, Nikolaos Ellinas, Georgios Vamvoukakis, Konstantinos Markopoulos, June Sig Sung

Advanced Speaker Embedding with Predictive Variance of Gaussian Distribution for Speaker Adaptation in TTS

Jaeuk Lee, Joon-Hyuk Chang

Zero-Shot Voice Conditioning for Denoising Diffusion TTS Models

Alon Levkovitch, Eliya Nachmani, Lior Wolf

One-Shot Speaker Adaptation Based on Initialization by Generative Adversarial Networks for TTS

Jaeuk Lee, Joon-Hyuk Chang

GlowVC: Mel-spectrogram space disentangling model for language-independent text-free voice conversion

Magdalena Proszewska, Grzegorz Beringer, Daniel Sáez-Trigueros, Thomas Merritt, Abdelhamid Ezzerg

Human-in-the-loop Speaker Adaptation for DNN-based Multi-speaker TTS

Kenta Udagawa, Yuki Saito, Hiroshi Saruwatari

Unify and Conquer: How Phonetic Feature Representation Affects Polyglot Text-To-Speech (TTS)

Ariadna Sánchez, Alessio Falai, Ziyao Zhang, Orazio Angelini, Kayoko Yanagisawa

Creating New Voices using Normalizing Flows

Piotr Biliński, Thomas Merritt, Abdelhamid Ezzerg, Kamil Pokora, Sebastian Cygert

Improving Speech Enhancement through Fine-Grained Speech Characteristics

Muqiao Yang, Joseph Konan, David Bick, Anurag Kumar, Shinji Watanabe

Efficient Transformer-based Speech Enhancement Using Long Frames and STFT Magnitudes

Danilo de Oliveira, Tal Peer, Timo Gerkmann

Convolutive Weighted Multichannel Wiener Filter Front-end for Distant Automatic Speech Recognition in Reverberant Multispeaker Scenarios

Mieszko Fraś, Marcin Witkowski, Konrad Kowalczyk

Deep Audio Waveform Prior

Arnon Turetzky, Tzvi Michelson, Yossi Adi, Shmuel Peleg

Enhancing Embeddings for Speech Classification in Noisy Conditions

Mohamed Nabih Ali, Alessio Brutti, Falavigna Daniele

Speech Enhancement with Score-Based Generative Models in the Complex STFT Domain

Simon Welker, Julius Richter, Timo Gerkmann

Refining DNN-based Mask Estimation using CGMM-based EM Algorithm for Multi-channel Noise Reduction

Julitta Bartolewska, Stanisław Kacprzak, Konrad Kowalczyk

Direction-Aware Joint Adaptation of Neural Speech Enhancement and Recognition in Real Multiparty Conversational Environments

Yicheng Du, Aditya Arie Nugraha, Kouhei Sekiguchi, Yoshiaki Bando, Mathieu Fontaine

DDS: A new device-degraded speech dataset for speech enhancement

Haoyu Li, Junichi Yamagishi

On the Role of Spatial, Spectral, and Temporal Processing for DNN-based Non-linear Multi-channel Speech Enhancement

Kristina Tesch, Nils-Hendrik Mohrmann, Timo Gerkmann

tPLCnet: Real-time Deep Packet Loss Concealment in the Time Domain Using a Short Temporal Context

Nils L. Westhausen, Bernd T. Meyer

Representation Selective Self-distillation and wav2vec 2.0 Feature Exploration for Spoof-aware Speaker Verification

Jin Woo Lee, Eungbeom Kim, Junghyun Koo, Kyogu Lee

SASV 2022: The First Spoofing-Aware Speaker Verification Challenge

Jee-weon Jung, Hemlata Tak, Hye-jin Shim, Hee-soo Heo, Bong-Jin Lee

A Subnetwork Approach for Spoofing Aware Speaker Verification

Alexander Alenin, Nikita Torgashov, Anton Okhotnikov, Rostislav Makarov, Ivan Yakovlev

Spoofing-Aware Attention based ASV Back-end with Multiple Enrollment Utterances and a Sampling Strategy for the SASV Challenge 2022

Chang Zeng, Lin Zhang, Meng Liu, Junichi Yamagishi

Two Methods for Spoofing-Aware Speaker Verification: Multi-Layer Perceptron Score Fusion Model and Integrated Embedding Projector

Jungwoo Heo, Ju-ho Kim, Hyun-seo Shin

HYU Submission for the SASV Challenge 2022: Reforming Speaker Embeddings with Spoofing-Aware Conditioning

Jeong-Hwan Choi, Joon-Young Yang, Ye-Rin Jeoung, Joon-Hyuk Chang

Detecting Dysfluencies in Stuttering Therapy Using wav2vec 2.0

Sebastian Peter Bayerl, Dominik Wagner, Elmar Noeth, Korbinian Riedhammer

Acoustic Representation Learning on Breathing and Speech Signals for COVID-19 Detection

Debottam Dutta, Debarpan Bhattacharya, Sriram Ganapathy, Amir Hossein Poorjam, Deepak Mittal

Data Augmentation for Dementia Detection in Spoken Language.

Dominika Woszczyk, Anna Hlédiková, Alican Akman, Soteris Demetriou, Björn Schuller

Automatic Detection of Speech Sound Disorder in Child Speech Using Posterior-based Speaker Representations

Si-Ioi Ng, Cymie Wing-Yee Ng, Jiarui Wang, Tan Lee

Detecting Heart Failure Through Voice Analysis using Self-Supervised Mode-Based Memory Fusion

Darshana Priyasad, Andi Partovi, Sridha Sridharan, Maryam Kashefpoor, Tharindu Fernando

Frame-Level Stutter Detection

John Harvill, Mark Hasegawa-Johnson, Chang D. Yoo

Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognition

Joanna Hong, Minsu Kim, Daehun Yoo, Yong Man Ro

Transformer-Based Video Front-Ends for Audio-Visual Speech Recognition for Single and Muti-Person Video

Dmitriy Serdyuk, Otavio Braga, Olivier Siohan

End-to-End multi-talker audio-visual ASR using an active speaker attention module

Richard Rose, Olivier Siohan

Word Discovery in Visually Grounded, Self-Supervised Speech Models

Puyuan Peng, David Harwath

AVATAR: Unconstrained Audiovisual Speech Recognition

Valentin Gabeur, Paul Hongsuck Seo, Arsha Nagrani, Chen Sun, Karteek Alahari

Transformer-Based Automatic Speech Recognition with Auxiliary Input of Source Language Text Toward Transcribing Simultaneous Interpretation

Shuta Taniguchi, Tsuneo Kato, Akihiro Tamura, Keiji Yasuda

Detecting Unintended Memorization in Language-Model-Fused ASR

W. Ronny Huang, Steve Chien, Om Dipakbhai Thakkar, Rajiv Mathews

Extracting Targeted Training Data from ASR Models, and How to Mitigate It

Ehsan Amid, Om Dipakbhai Thakkar, Arun Narayanan, Rajiv Mathews, Françoise Beaufays

Towards End-to-End Private Automatic Speaker Recognition

Francisco Teixeira, Alberto Abad, Bhiksha Raj, Isabel Trancoso

Are disentangled representations all you need to build speaker anonymization systems?

Champion Pierre, Anthony Larcher, Denis Jouvet

Attacker Attribution of Audio Deepfakes

Nicolas Müller, Franziska Diekmann, Jennifer Williams

Does Audio Deepfake Detection Generalize?

Nicolas Müller, Pavel Czempin, Franziska Diekmann, Adam Froghyar, Konstantin Böttinger

Deformable CNN and Imbalance-Aware Feature Learning for Singing Technique Classification

Yuya Yamamoto, Juhan Nam, Hiroko Terasawa

Interactive Auido-text Representation for Automated Audio Captioning with Contrastive Learning

Chen Chen, Nana Hou, Yuchen Hu, Heqing Zou, Xiaofeng Qi

On Breathing Pattern Information in Synthetic Speech

Zohreh Mostaani, Mathew Magimai Doss

Frequency Dynamic Convolution: Frequency-Adaptive Pattern Recognition for Sound Event Detection

Hyeonuk Nam, Seong-Hu Kim, Byeong-Yun Ko, Yong-Hwa Park

CNN-based Audio Event Recognition for Automated Violence Classification and Rating for Prime Video Content

Mayank Sharma, Tarun Gupta, Kenny Qiu, Xiang Hao, Raffay Hamid

Efficient Training of Audio Transformers with Patchout

Khaled Koutini, Jan Schlüter, Hamid Eghbal-zadeh, Gerhard Widmer

Speech2Slot: A Limited Generation Framework with Boundary Detection for Slot Filling from Speech

Pengwei Wang, Yinpei Su, Xiaohuan Zhou, Xin Ye, Liangchen Wei

Analysis of praising skills focusing on utterance contents

Asahi Ogushi, Toshiki Onishi, Yohei Tahara, Ryo Ishii, Atsushi Fukayama

WavPrompt: Towards Few-Shot Spoken Language Understanding with Frozen Language Models

Heting Gao, Junrui Ni, Kaizhi Qian, Yang Zhang, Shiyu Chang

A Multi-Task BERT Model for Schema-Guided Dialogue State Tracking

Eleftherios Kapelonis, Efthymios Georgiou, Alexandros Potamianos

Toward Low-Cost End-to-End Spoken Language Understanding

Marco Dinarelli, Marco Naguib, François Portet

Small Changes Make Big Differences: Improving Multi-turn Response Selection in Dialogue Systems via Fine-Grained Contrastive Learning

Yuntao Li, Can Xu, Huang Hu, Lei Sha, Yan Zhang

Pay More Attention to History: A Context Modeling Strategy for Conversational Text-to-SQL

Yuntao Li, Hanchu Zhang, Yutian Li, Sirui Wang, Wei Wu

Incorporating Dual-Aware with Hierarchical Interactive Memory Networks for Task-Oriented Dialogue

yangyang Ou, Peng Zhang, Jing Zhang, Hui Gao, Xing Ma

Adversarial Knowledge Distillation For Robust Spoken Language Understanding

Ye Wang, Baishun Ling, Yanmeng Wang, Junhao Xue, Shaojun Wang

Meta Auxiliary Learning for Low-resource Spoken Language Understanding

Yingying Gao, Junlan Feng, Chao Deng, Shilei Zhang

Low-bit Shift Network for End-to-End Spoken Language Understanding

Anderson R. Avila, Khalil Bibi, Rui Heng Yang, Xinlin Li, Chao Xing

Improving Spoken Language Understanding with Cross-Modal Contrastive Learning

Jingjing Dong, Jiayi Fu, Peng Zhou, Hao Li, Xiaorui Wang

Japanese ASR-Robust Pre-trained Language Model with Pseudo-Error Sentences Generated by Grapheme-Phoneme Conversion

Yasuhito Ohsugi, Itsumi Saito, Kyosuke Nishida, Sen Yoshida

Tokenwise Contrastive Pretraining for Finer Speech-to-BERT Alignment in End-to-End Speech-to-Intent Systems

Vishal Sunder, Eric Fosler-Lussier, Samuel Thomas, Hong-Kwang Kuo, Brian Kingsbury

SPLICEOUT: A Simple and Efficient Audio Augmentation Method

Arjit Jain, Pranay Reddy Samala, Deepak Mittal, Preethi Jyothi, Maneesh Singh

Streaming Target-Speaker ASR with Neural Transducer

Takafumi Moriya, Hiroshi Sato, Tsubasa Ochiai, Marc Delcroix, Takahiro Shinozaki

Online Continual Learning of End-to-End Speech Recognition Models

Muqiao Yang, Ian Lane, Shinji Watanabe

PISA: PoIncaré Saliency-Aware Interpolative Augmentation

Ramit Sawhney, Megh Thakkar, Vishwa Shah, Puneet Mathur, Vasu Sharma

Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data

Junyi Ao, Ziqiang Zhang, Long Zhou, Shujie LIU, Haizhou Li

Censer: Curriculum Semi-supervised Learning for Speech Recognition Based on Self-supervised Pre-training

Bowen Zhang, Songjun Cao, Xiaoming Xhang, Yike Zhang, Long Ma

Speech Pre-training with Acoustic Piece

Shuo Ren, Shujie LIU, Yu Wu, Long Zhou, Furu Wei

Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training

Chengyi Wang, Yiming Wang, Yu Wu, Sanyuan Chen, Jinyu Li

Improving Generalization of Deep Neural Network Acoustic Models with Length Perturbation and N-best Based Label Smoothing

Xiaodong Cui, George Saon, Tohru Nagano, Masayuki Suzuki, Takashi Fukuda

Knowledge Distillation For CTC-based Speech Recognition Via Consistent Acoustic Representation Learning

Sanli Tian, Keqi Deng, Zehan Li, Lingxuan Ye, Gaofeng Cheng

Decoupled Federated Learning for ASR with Non-IID Data

Han Zhu, Jindong Wang, Gaofeng Cheng, Pengyuan Zhang, Yonghong Yan

Confidence Score Based Conformer Speaker Adaptation for Speech Recognition

Jiajun Deng, Xurong Xie, Tianzi Wang, Mingyu Cui, Boyang Xue

Knowledge Transfer and Distillation from Autoregressive to Non-Autoregessive Speech Recognition

Xun Gong, Zhikai Zhou, Yanmin Qian

A Complementary Joint Training Approach Using Unpaired Speech and Text A Complementary Joint Training Approach Using Unpaired Speech and Text

Yeqian Du, Jie Zhang, Qiu-Shi Zhu, Lirong Dai, Minghui Wu

Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition

Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen

Disentanglement of Emotional Style and Speaker Identity for Expressive Voice Conversion

Zongyang Du, Berrak Sisman, Kun Zhou, Haizhou Li

Towards Improved Zero-shot Voice Conversion with Conditional DSVAE

Jiachen Lian, Chunlei Zhang, Gopala Krishna Anumanchipalli, Dong Yu

DeID-VC: Speaker De-identification via Zero-shot Pseudo Voice Conversion

Ruibin Yuan, Yuxuan Wu, Jacob Li, Jaxter Kim

VoiceMe: Personalized voice generation in TTS

Pol van Rijn, Silvan Mertes, Dominik Schiller, Piotr Dura, Hubert Siuzdak

Accent Conversion using Pre-trained Model and Synthesized Data from Voice Conversion

Tuan Nam Nguyen, Ngoc-Quan Pham, Alexander Waibel

Streamable Speech Representation Disentanglement and Multi-Level Prosody Modeling for Live One-Shot Voice Conversion

Haoquan Yang, Liqun Deng, Yu Ting Yeung, Nianzu Zheng, Yong Xu