Interspeech 2022

1,123 papers

Adversarial and Sequential Training for Cross-lingual Prosody Transfer TTS

Min-Kyung Kim, Joon-Hyuk Chang

Predicting VQVAE-based Character Acting Style from Quotation-Annotated Text for Audiobook Speech Synthesis

Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi, Yuki Saito, Yusuke Ijima

Expressive, Variable, and Controllable Duration Modelling in TTS

Syed Ammar Abbas, Thomas Merritt, Alexis Moinet, Sri Karlapati, Ewa Muszyńska

DDOS: A MOS Prediction Framework utilizing Domain Adaptive Pre-training and Distribution of Opinion Scores

Wei-Cheng Tseng, Wei-Tsung Kao, Hung-yi Lee

The VoiceMOS Challenge 2022

Wen Chin Huang, Erica Cooper, Yu Tsao, Hsin-Min Wang, Tomoki Toda

Using Rater and System Metadata to Explain Variance in the VoiceMOS Challenge 2022 Dataset

Michael Chinen, Jan Skoglund, Chandan K. A. Reddy, Alessandro Ragano, Andrew Hines

Automatic Mean Opinion Score Estimation with Temporal Modulation Features on Gammatone Filterbank for Speech Assessment

Huy Nguyen, Kai Li, Masashi Unoki

UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022

Takaaki Saeki, Detai Xin, Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi

The ZevoMOS entry to VoiceMOS Challenge 2022

Adriana Stan

Low-Latency Online Streaming VideoQA Using Audio-Visual Transformers

Chiori Hori, Takaaki Hori, Jonathan Le Roux

Investigating perception of spoken dialogue acceptability through surprisal

Sarenne Carrol Wallbridge, Catherine Lai, Peter Bell

Does Utterance entails Intent?: Evaluating Natural Language Inference Based Setup for Few-Shot Intent Detection

Ayush Kumar, Vijit Malik, Jithendra Vepa

Interpretabilty of Speech Emotion Recognition modelled using Self-Supervised Speech and Text Pre-Trained Embeddings

K V Vijay Girish, Srikanth Konjeti, Jithendra Vepa

Hesitations in Urdu/Hindi: Distribution and Properties of Fillers & Silences

Farhat Jabeen, Simon Betz

Response Timing Estimation for Spoken Dialog System using Dialog Act Estimation

Jin Sakuma, Shinya Fujie, Tetsunori Kobayashi

Improving Mispronunciation Detection with Wav2vec2-based Momentum Pseudo-Labeling for Accentedness and Intelligibility Assessment

Mu Yang, Kevin Hirschi, Stephen Daniel Looney, Okim Kang, John H.L. Hansen

The Effects of Implicit and Explicit Feedback in an ASR-based Reading Tutor for Dutch First-graders

Yu Bai, Ferdy Hubers, Catia Cucchiarini, Roeland van Hout, Helmer Strik

View-Specific Assessment of L2 Spoken English

Stefano Bannò, Bhanu Balusu, Mark Gales, Kate Knill, Konstantinos Kyriakopoulos

Automatic Prosody Evaluation of L2 English Read Speech in Reference to Accent Dictionary with Transformer Encoder

Yu Suzuki, Tsuneo Kato, Akihiro Tamura

Detection of Learners' Listening Breakdown with Oral Dictation and Its Use to Model Listening Skill Improvement Exclusively Through Shadowing

Takuya Kunihara, Chuanbo Zhu, Daisuke Saito, Nobuaki Minematsu, Noriko Nakanishi

Variations of multi-task learning for spoken language assessment

Jeremy Heng Meng Wong, Huayun Zhang, Nancy Chen

Separator-Transducer-Segmenter: Streaming Recognition and Segmentation of Multi-party Speech

Ilya Sklyar, Anna Piunova, Christian Osendorfer

Multiple-hypothesis RNN-T Loss for Unsupervised Fine-tuning and Self-training of Neural Transducer

Cong-Thanh Do, Mohan Li, Rama Doddipatla

Memory-Efficient Training of RNN-Transducer with Sampled Softmax

Jaesong Lee, Lukas Lee, Shinji Watanabe

Knowledge Distillation via Module Replacing for Automatic Speech Recognition with Recurrent Neural Network Transducer

Kaiqi Zhao, Hieu Nguyen, Animesh Jain, Nathan Susanj, Athanasios Mouchtaris

ConvRNN-T: Convolutional Augmented Recurrent Neural Network Transducers for Streaming Speech Recognition

Martin Radfar, Rohit Barnwal, Rupak Vignesh Swaminathan, Feng-Ju Chang, Grant P. Strimel

Analyzing Language-Independent Speaker Anonymization Framework under Unseen Conditions

Xiaoxiao Miao, Xin Wang, Erica Cooper, Junichi Yamagishi, Natalia Tomashenko

Ultra-Low-Bitrate Speech Coding with Pretrained Transformers

Ali Siahkoohi, Michael Chinen, Tom Denton, W. Bastiaan Kleijn, Jan Skoglund

Phase Vocoder For Time Stretch Based On Center Frequency Estimation

Donghyeon Kim, Bowon Lee

Optimization of Deep Neural Network (DNN) Speech Coder Using a Multi Time Scale Perceptual Loss Function

Joon Byun, Seungmin Shin, Jongmo Sung, Seungkwon Beack, Youngcheol Park

SelfRemaster: Self-Supervised Speech Restoration with Analysis-by-Synthesis Approach Using Channel Modeling

Takaaki Saeki, Shinnosuke Takamichi, Tomohiko Nakamura, Naoko Tanji, Hiroshi Saruwatari

NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Rates

Seungu Han, Junhyeok Lee

The DKU-OPPO System for the 2022 Spoofing-Aware Speaker Verification Challenge

Xingming Wang, Xiaoyi Qin, Yikang Wang, Yunfei Xu, Ming Li

SA-SASV: An End-to-End Spoof-Aggregated Spoofing-Aware Speaker Verification System

Zhongwei Teng, Quchen Fu, Jules White, Maria Powell, Douglas Schmidt

NRI-FGSM: An Efficient Transferable Adversarial Attack for Speaker Recognition Systems

Hao Tan, Junjian Zhang, Huan Zhang, Le Wang, Yaguan Qian

Backend Ensemble for Speaker Verification and Spoofing Countermeasure

Li Zhang, Yue Li, Huan Zhao, Qing Wang, Lei Xie

SASV Based on Pre-trained ASV System and Integrated Scoring Module

Yuxiang Zhang, Zhuo Li, Wenchao Wang, Pengyuan Zhang

Norm-constrained Score-level Ensemble for Spoofing Aware Speaker Verification

Peng Zhang, Peng Hu, Xueliang Zhang

The CLIPS System for 2022 Spoofing-Aware Speaker Verification Challenge

Jucai Lin, Tingwei Chen, Jingbiao Huang, Ruidong Fang, Jun Yin

End-to-end framework for spoof-aware speaker verification

Woohyun Kang, Md Jahangir Alam, Abderrahim Fathan

Spoofing-Aware Speaker Verification by Multi-Level Fusion

Haibin Wu, Lingwei Meng, Jiawen Kang, Jinchao Li, Xu Li

CoCA-MDD: A Coupled Cross-Attention based Framework for Streaming Mispronunciation Detection and Diagnosis

Nianzu Zheng, Liqun Deng, Wenyong Huang, Yu Ting Yeung, Baohua Xu

RefTextLAS: Reference Text Biased Listen, Attend, and Spell Model For Accurate Reading Evaluation

Phani Sankar Nidadavolu, Na Xu, Nick Jutila, Ravi Teja Gadde, Aswarth Abhilash Dara

An Alignment Method Leveraging Articulatory Features for Mispronunciation Detection and Diagnosis in L2 English

Qi Chen, Binghuai Lin, Yanlu Xie

Using Fluency Representation Learned from Sequential Raw Features for Improving Non-native Fluency Scoring

Kaiqi Fu, Shaojun Gao, Xiaohai Tian, Wei Li, Ma Zejun

BiCAPT: Bidirectional Computer-Assisted Pronunciation Training with Normalizing Flows

Zhan Zhang, Yuehai Wang, Jianyi Yang

End-to-end Mispronunciation Detection with Simulated Error Distance

Zhan Zhang, Yuehai Wang, Jianyi Yang

Challenges remain in Building ASR for Spontaneous Preschool Children Speech in Naturalistic Educational Environments

Satwik Dutta, Sarah Anne Tao, Jacob C. Reyna, Rebecca Elizabeth Hacker, Dwight W. Irvin

L2-GEN: A Neural Phoneme Paraphrasing Approach to L2 Speech Synthesis for Mispronunciation Diagnosis

Daniel Zhang, Ashwinkumar Ganesan, Sarah Campbell, Daniel Korzekwa

Self-Supervised Learning with Multi-Target Contrastive Coding for Non-Native Acoustic Modeling of Mispronunciation Verification

Longfei Yang, Jinsong Zhang, Takahiro Shinozaki

A Hierarchical Speaker Representation Framework for One-shot Singing Voice Conversion

Xu Li, Shansong Liu, Ying Shan

Synthesizing Near Native-accented Speech for a Non-native Speaker by Imitating the Pronunciation and Prosody of a Native Speaker

Raymond Chung, Brian Mak

Normalization of code-switched text for speech synthesis

Sreeram Manghat, Sreeja Manghat, Tanja Schultz

Towards Improving the Expressiveness of Singing Voice Synthesis with BERT Derived Semantic Information

Shaohuan Zhou, Shun Lei, Weiya You, Deyi Tuo, Yuren You

Towards high-fidelity singing voice conversion with acoustic reference and contrastive predictive coding

Chao Wang, Zhonghao Li, Benlai Tang, Xiang Yin, Yuan Wan

Pronunciation Dictionary-Free Multilingual Speech Synthesis by Combining Unsupervised and Supervised Phonetic Representations

Chang Liu, Zhen-Hua Ling, Ling-Hui Chen

Muskits: an End-to-end Music Processing Toolkit for Singing Voice Synthesis

Jiatong Shi, Shuai Guo, Tao Qian, Tomoki Hayashi, Yuning Wu

SingAug: Data Augmentation for Singing Voice Synthesis with Cycle-consistent Training Strategy

Shuai Guo, Jiatong Shi, Tao Qian, Shinji Watanabe, Qin Jin

Learn2Sing 2.0: Diffusion and Mutual Information-Based Target Speaker SVS by Learning from Singing Teacher

Heyang Xue, Xinsheng Wang, Yongmao Zhang, Lei Xie, Pengcheng Zhu

KaraTuner: Towards End-to-End Natural Pitch Correction for Singing Voice in Karaoke

Xiaobin Zhuang, Huiran Yu, Weifeng Zhao, Tao Jiang, Peng Hu

Decoupled Pronunciation and Prosody Modeling in Meta-Learning-based Multilingual Speech Synthesis

Yukun Peng, Zhenhua Ling

WeSinger: Data-augmented Singing Voice Synthesis with Auxiliary Losses

Zewang Zhang, Yibin Zheng, Xinhui Li, Li Lu

Exploring Timbre Disentanglement in Non-Autoregressive Cross-Lingual Text-to-Speech

Haoyue Zhan, Xinyuan Yu, Haitong Zhang, Yang Zhang, Yue Lin

Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesis

Yu Wang, Xinsheng Wang, Pengcheng Zhu, Jie Wu, Hanzhao Li

Generating gender-ambiguous voices for privacy-preserving speech recognition

Dimitrios Stoidis, Andrea Cavallaro

VoiceFixer: A Unified Framework for High-Fidelity Speech Restoration

Haohe Liu, Xubo Liu, Qiuqiang Kong, Qiao Tian, Yan Zhao

Neural Vocoder is All You Need for Speech Super-resolution

Haohe Liu, Woosung Choi, Xubo Liu, Qiuqiang Kong, Qiao Tian

Cross-Scale Vector Quantization for Scalable Neural Speech Coding

Xue Jiang, Xiulian Peng, Huaying Xue, yuan zhang, Yan Lu

Towards Error-Resilient Neural Speech Coding

Huaying Xue, Xiulian Peng, Xue Jiang, Yan Lu

NESC: Robust Neural End-2-End Speech Coding with GANs

Nicola Pia, Kishan Gupta, Srikanth Korse, Markus Multrus, Guillaume Fuchs

Preventing sensitive-word recognition using self-supervised learning to preserve user-privacy for automatic speech recognition

Yuchen Liu, Apu Kapadia, Donald Williamson

Speaker recognition-assisted robust audio deepfake detection

Jiahui Pan, Shuai Nie, Hui Zhang, Shulin He, Kanghao Zhang

Introducing Auxiliary Text Query-modifier to Content-based Audio Retrieval

Daiki Takeuchi, Yasunori Ohishi, Daisuke Niizumi, Noboru Harada, Kunio Kashino

Impact of Acoustic Event Tagging on Scene Classification in a Multi-Task Learning Framework

Rahil Parikh, Harshavardhan Sundar, Ming Sun, Chao Wang, Spyros Matsoukas

WideResNet with Joint Representation Learning and Data Augmentation for Cover Song Identification

Shichao Hu, Bin Zhang, JinHong Lu, Yiliang Jiang, Wucheng Wang

Novel Augmentation Schemes for Device Robust Acoustic Scene Classification

Sukanya Sonowal, Anish Tamse

Deep Segment Model for Acoustic Scene Classification

Yajian Wang, Jun Du, Hang Chen, Qing Wang, Chin-Hui Lee

ATST: Audio Representation Learning with Teacher-Student Transformer

Xian Li, Xiaofei Li

iCNN-Transformer: An improved CNN-Transformer with Channel-spatial Attention and Keyword Prediction for Automated Audio Captioning

Kun Chen, Jun Wang, Feng Deng, Xiaorui Wang

MusicNet: Compact Convolutional Neural Network for Real-time Background Music Detection

Chandan Reddy, Vishak Gopal, Harishchandra Dubey, Ross Cutler, Sergiy Matusevych

Audio-Visual Scene Classification Based on Multi-modal Graph Fusion

Han Lei, Ning Chen

ADFF: Attention Based Deep Feature Fusion Approach for Music Emotion Recognition

Zi Huang, Shulei Ji, Zhilan Hu, Chuangjian Cai, Jing Luo

CT-SAT: Contextual Transformer for Sequential Audio Tagging

Yuanbo Hou, Zhaoyi Liu, Bo Kang, Yun Wang, Dick Botteldooren

On Metric Learning for Audio-Text Cross-Modal Retrieval

Xinhao Mei, Xubo Liu, Jianyuan Sun, Mark Plumbley, Wenwu Wang

Bayesian Recurrent Units and the Forward-Backward Algorithm

Alexandre Bittar, Philip N. Garner

Automatic Learning of Subword Dependent Model Scales

Felix Meyer, Wilfried Michel, Mohammad Zeineldeen, Ralf Schlüter, Hermann Ney

Knowledge distillation for In-memory keyword spotting model

Zeyang Song, Qi Liu, Qu Yang, Haizhou Li

Generalizing RNN-Transducer to Out-Domain Audio via Sparse Self-Attention Layers

Juntae Kim, Jeehye Lee

Kyuhong Shim, Wonyong Sung

Recent improvements of ASR models in the face of adversarial attacks

Raphael Olivier, Bhiksha Raj

End-to-End Spontaneous Speech Recognition Using Disfluency Labeling

Koharu Horii, Meiko Fukuda, Kengo Ohta, Ryota Nishimura, Atsunori Ogawa

SepTr: Separable Transformer for Audio Spectrogram Processing

Nicolaea Catalin Ristea, Radu Tudor Ionescu, Fahad Shahbaz Khan

FiLM Conditioning with Enhanced Feature to the Transformer-based End-to-End Noisy Speech Recognition

Da-Hee Yang, Joon-Hyuk Chang

MAESTRO: Matched Speech Text Representations through Modality Matching

Zhehuai Chen, Yu Zhang, Andrew Rosenberg, Bhuvana Ramabhadran, Pedro J. Moreno

Exploring the influence of fine-tuning data on wav2vec 2.0 model for blind speech quality prediction

Helard Becerra, Alessandro Ragano, Andrew Hines

Pre-trained Speech Representations as Feature Extractors for Speech Quality Assessment in Online Conferencing Applications

Bastiaan Tamm, Helena Balabin, Rik Vandenberghe, Hugo Van hamme

Transformer Networks for Non-Intrusive Speech Quality Prediction

M K Jayesh, Mukesh Sharma, Praneeth Vonteddu, Mahaboob Ali Basha Shaik, Sriram Ganapathy

Multitask Learning for Low Resource Spoken Language Understanding

Quentin Meeus, Marie Francine Moens, Hugo Van hamme

End-to-end model for named entity recognition from speech without paired training data

Salima Mdhaffar, Jarod Duret, Titouan Parcollet, Yannick Estève

Evidence of Onset and Sustained Neural Responses to Isolated Phonemes from Intracranial Recordings in a Voice-based Cursor Control Task

Kevin Meng, Seo-Hyun Lee, Farhad Goodarzy, Simon Vogrin, Mark J. Cook