Interspeech 2023

1,141 papers

SASPEECH: A Hebrew Single Speaker Dataset for Text To Speech and Voice Conversion

Orian Sharoni, Roee Shenberg, Erica Cooper

CALLS: Japanese Empathetic Dialogue Speech Corpus of Complaint Handling and Attentive Listening in Customer Center

Yuki Saito, Eiji Iimori, Shinnosuke Takamichi, Kentaro Tachibana, Hiroshi Saruwatari

Speaker-independent neural formant synthesis

Pablo Pérez Zarazaga, Zofia Malisz, Gustav Eje Henter, Lauri Juvela

Why We Should Report the Details in Subjective Evaluation of TTS More Rigorously

Cheng-Han Chiang, Wei-Ping Huang, Hung-yi Lee

Expressive Machine Dubbing Through Phrase-level Cross-lingual Prosody Transfer

Jakub Swiatkowski, Duo Wang, Mikolaj Babianski, Giuseppe Coccia, Patrick Lumban Tobing

PronScribe: Highly Accurate Multimodal Phonemic Transcription From Speech and Text

Yang Yu, Matthew Perez, Ankur Bapna, Fadi Haik, Siamak Tazari

High-Quality Automatic Voice Over with Accurate Alignment: Supervision through Self-Supervised Discrete Speech Units

Junchen Lu, Berrak Sisman, Mingyang Zhang, Haizhou Li

Improving Bilingual TTS Using Language And Phonology Embedding With Embedding Strength Modulator

Fengyu Yang, Jian Luan, Meng Meng, Yujun Wang

CVTE-Poly: A New Benchmark for Chinese Polyphone Disambiguation

Siheng Zhang, Xingjun Tan, Yanqiang Lei, Xianxiang Wang, Zhizhong Zhang

Multilingual Text-to-Speech Synthesis for Turkic Languages Using Transliteration

Rustem Yeshpanov, Saida Mussakhojayeva, Yerbolat Khassanov

Diffusion-based accent modelling in speech synthesis

Kamil Deja, Georgi Tinchev, Marta Czarnowska, Marius Cotescu, Jasha Droppo

ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpus

Ajinkya Kulkarni, Atharva Kulkarni, Sara Abedalmon'em Mohammad Shatnawi, Hanan Aldarmaki

XPhoneBERT: A Pre-trained Multilingual Model for Phoneme Representations for Text-to-Speech

Linh The Nguyen, Thinh Pham, Dat Quoc Nguyen

UniFLG: Unified Facial Landmark Generator from Text or Speech

Kentaro Mitsui, Yukiya Hono, Kei Sawada

LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpus

Yuma Koizumi, Heiga Zen, Shigeki Karita, Yifan Ding, Kohei Yatabe

Analysis of Mean Opinion Scores in Subjective Evaluation of Synthetic Speech Based on Tail Probabilities

Yusuke Yasuda, Tomoki Toda

GenerTTS: Pronunciation Disentanglement for Timbre and Style Generalization in Cross-Lingual Text-to-Speech

Yahuan Cong, Haoyu Zhang, Haopeng Lin, Shichao Liu, Chunfeng Wang

Automatic Evaluation of Turn-taking Cues in Conversational Speech Synthesis

Erik Ekstedt, Siyang Wang, Eva Szekely, Joakim Gustafson, Gabriel Skantze

Zero-Shot Accent Conversion using Pseudo Siamese Disentanglement Network

Dongya Jia, Qiao Tian, Kainan Peng, Jiaxin Li, Yuanzhe Chen

Robust Feature Decoupling in Voice Conversion by Using Locality-Based Instance Normalization

Yewei Gu, Xianfeng Zhao, Xiaowei Yi

Resource-Efficient Fine-Tuning Strategies for Automatic MOS Prediction in Text-to-Speech for Low-Resource Languages

Phat Do, Matt Coler, Jelske Dijkstra, Esther Klabbers

The Effects of Input Type and Pronunciation Dictionary Usage in Transfer Learning for Low-Resource Text-to-Speech

Phat Do, Matt Coler, Jelske Dijkstra, Esther Klabbers

Investigation of Music Emotion Recognition Based on Segmented Semi-Supervised Learning

Yifu Sun, Xulong Zhang, Jianzong Wang, Ning Cheng, Kaiyu Hu

Obstructive sleep apnea screening with breathing sounds and respiratory effort: a multimodal deep learning approach

Hector E. Romero, Ning Ma, Guy J. Brown, Sam Johnson

Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image Generation

Guy Yariv, Itai Gat, Lior Wolf, Yossi Adi, Idan Schwartz

Remote Assessment for ALS using Multimodal Dialog Agents: Data Quality, Feasibility and Task Compliance

Vanessa Richter, Michael Neumann, Jordan Green, Brian Richburg, Oliver Roesler

Patch-Mix Contrastive Learning with Audio Spectrogram Transformer on Respiratory Sound Classification

Sangmin Bae, June-Woo Kim, Won-Yang Cho, Hyerim Baek, Soyoun Son

AsthmaSCELNet: A Lightweight Supervised Contrastive Embedding Learning Framework for Asthma Classification Using Lung Sounds

Arka Roy, Udit Satija

Spatialization Quality Metric for Binaural Speech

Pranay Manocha, Israel Dejene Gebru, Anurag Kumar, Dejan Markovic, Alexander Richard

RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Music

Haojie Wei, Xueke Cao, Tangpeng Dan, Yueguo Chen

A Snoring Sound Dataset for Body Position Recognition: Collection, Annotation, and Analysis

Li Xiao, Xiuping Yang, Xinhong Li, Weiping Tu, Xiong Chen

Automatic Exploration of Optimal Data Processing Operations for Sound Data Augmentation Using Improved Differentiable Automatic Data Augmentation

Toki Sugiura, Hiromitsu Nishizaki

Do Vocal Breath Sounds Encode Gender Cues for Automatic Gender Classification?

Mohammad Shaique Solanki, Ashutosh Bharadwaj, Jeevan Kylash, Prasanta Kumar Ghosh

Xiaoicesing 2: A High-Fidelity Singing Voice Synthesizer Based on Generative Adversarial Network

Wang Chunhui, Chang Zeng, Xing He

MTANet: Multi-band Time-frequency Attention Network for Singing Melody Extraction from Polyphonic Music

Yuan Gao, Ying Hu, Liusong Wang, Hao Huang, Liang He

A Multi-Scale Attentive Transformer for Multi-Instrument Symbolic Music Generation

Xipin Wei, Junhui Chen, Zirui Zheng, Li Guo, Lantian Li

MOSLight: A Lightweight Data-Efficient System for Non-Intrusive Speech Quality Assessment

Zitong Li, Wei Li

Outlier-aware Inlier Modeling and Multi-scale Scoring for Anomalous Sound Detection via Multitask Learning

Yucong Zhang, Suo Hongbin, Yulong Wan, Ming Li

A Compressed Synthetic Speech Detection Method with Compression Feature Embedding

Jinghong Zhang, Xiaowei Yi, Xianfeng Zhao

What do self-supervised speech representations encode? An analysis of languages, varieties, speaking styles and speakers

Julian Linke, Mate Kadar, Gergely Dosinszky, Peter Mihajlik, Gernot Kubin

Handling the Alignment for Wake Word Detection: A Comparison Between Alignment-Based, Alignment-Free and Hybrid Approaches

Vinicius Ribeiro, Yiteng Huang, Yuan Shangguan, Zhaojun Yang, Li Wan

Improving Speaker Verification with Self-Pretrained Transformer Models

Junyi Peng, Oldřich Plchot, Themos Stafylakis, Ladislav Mošner, Lukas Burget

Exploring the Impact of Back-End Network on Wav2vec 2.0 for Dialect Identification

Qibao Luo, Ruohua Zhou

Label Aware Speech Representation Learning For Language Identification

Shikhar Vashishth, Shikhar Bharadwaj, Sriram Ganapathy, Ankur Bapna, Min Ma

Spoofing Attacker Also Benefits from Self-Supervised Pretrained Model

Aoi Ito, Shota Horiguchi

Adversarial Diffusion Probability Model For Cross-domain Speaker Verification Integrating Contrastive Loss

Xinmei Su, Xiang Xie, Fengrun Zhang, Chenguang Hu

Adaptive Neural Network Quantization For Lightweight Speaker Verification

Haoyu Wang, Bei Liu, Yifei Wu, Yanmin Qian

On the Robustness of Arabic Speech Dialect Identification

Peter Sullivan, AbdelRahim Elmadany, Muhammad Abdul-Mageed

A Compact End-to-End Model with Local and Global Context for Spoken Language Identification

Fei Jia, Nithin Rao Koluguri, Jagadeesh Balam, Boris Ginsburg

Disentangled Representation Learning for Multilingual Speaker Recognition

Kihyun Nam, Youkyum Kim, Jaesung Huh, Hee-soo Heo, Jee-weon Jung

Encoder-decoder Multimodal Speaker Change Detection

Jee-weon Jung, Soonshin Seo, Hee-soo Heo, Geonmin Kim, You Jin Kim

North Sámi Dialect Identification with Self-supervised Speech Models

Sofoklis Kakouros, Katri Hiovain-Asikainen

CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Masking

Hui Wang, Siqi Zheng, Yafeng Chen, Luyao Cheng, Qian Chen

From adaptive score normalization to adaptive data normalization for speaker verification systems

Sandro Cumani, Salvatore Sarni

CommonAccent: Exploring Large Acoustic Pretrained Models for Accent Classification Based on Common Voice

Juan Zuluaga-Gomez, Sara Ahmed, Danielius Visockas, Cem Subakan

Conformer-based Language Embedding with Self-Knowledge Distillation for Spoken Language Identification

Feng Wang, Lingyan Huang, Tao Li, Qingyang Hong, Lin Li

A conformer-based classifier for variable-length utterance processing in anti-spoofing

Eros Rosello, Alejandro Gomez-Alanis, Angel M. Gomez, Antonio Peinado

Defense Against Adversarial Attacks on Audio DeepFake Detection

Piotr Kawa, Marcin Plata, Piotr Syga

One-Step Knowledge Distillation and Fine-Tuning in Using Large Pre-Trained Self-Supervised Learning Models for Speaker Verification

Jungwoo Heo, Chan-yeong Lim, Ju-ho Kim, Hyun-seo Shin, Ha-Jin Yu

Cross-lingual/Cross-channel Intent Detection in Contact-Center Conversations

Suraj Agrawal, Aashraya Sachdeva, Soumya Jain, Cijo George, Jithendra Vepa

Fast Enrollable Streaming Keyword Spotting System: Training and Inference using a Web Browser

Namhyun Cho, Sunmin Kim, Yoseb Kang, Heeman Kim

Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models

Liam Dugan, Anshul Wadhawan, Kyle Spence, Chris Callison-Burch, Morgan McGuire

Federated Learning Toolkit with Voice-based User Verification Demo

Prathamesh Mandke, Rachel Oberst, Matthias Reisser, Avĳit Chakraborty, Christos Louizos

Tailored Real-Time Call Summarization System for Contact Centers

Aashraya Sachdeva, Sai Nishanth Padala, Anup Pattnaik, Varun Nathan, Cijo George

CauSE: Causal Search Engine for Understanding Contact-Center Conversations

Anup Pattnaik, Tanay Narshana, Aashraya Sachdeva, Cijo George, Jithendra Vepa

NeMo Forced Aligner and its application to word alignment for subtitle generation

Elena Rastorgueva, Vitaly Lavrukhin, Boris Ginsburg

COnVoy: A Contact Center Operated Pipeline for Voice of Customer Discovery

Rishabh Tripathi, Digvijay Anil Ingle, Ayush Kumar, Cijo George, Jithendra Vepa

What questions are my customers asking?: Towards Actionable Insights from Customer Questions in Contact Center Calls

Varun Nathan, Devashish Deshpande, Ayush Kumar, Cijo George, Jithendra Vepa

Video Summarization Leveraging Multimodal Information for Presentations

Hanchao Liu, Dapeng Chen, Rongjun Li, Wenyuan Xue, Wei Peng

FOOCTTS: Generating Arabic Speech with Acoustic Environment for Football Commentator

Massa Baali, Ahmed M. Ali

Let's Give a Voice to Conversational Agents in Virtual Reality

Michele Yin, Gabriel Roccabruna, Abhinav Azad, Giuseppe Riccardi

Adaptation of Whisper models to child speech recognition

Rishabh Jain, Andrei Barcovschi, Mariam Yiwere, Peter Corcoran, Horia Cucu

An ASR-enabled Reading Tutor: Investigating Feedback to Optimize Interaction for Learning to Read

Yu Bai, Ferdy Hubers, Catia Cucchiarini, Roeland van Hout, Helmer Strik

Automatic Assessment of Oral Reading Accuracy for Reading Diagnostics

Bo Molenaar, Cristian Tejedor-García, Catia Cucchiarini, Helmer Strik

Joint Learning Feature and Model Adaptation for Unsupervised Acoustic Modelling of Child Speech

Richeng Duan

Cross-linguistic Emotion Perception in Human and TTS Voices

Iona Gessinger, Michelle Cohn, Benjamin R. Cowan, Georgia Zellou, Bernd Möbius

Pardon my disfluency: The impact of disfluency effects on the perception of speaker competence and confidence

Ambika Kirkland, Joakim Gustafson, Eva Szekely

Influence of Personal Traits on Impressions of One's Own Voice

Hikaru Yanagida, Yusuke Ijima, Naohiro Tawara

Voice Passing : a Non-Binary Voice Gender Prediction System for evaluating Transgender voice transition

David Doukhan, Simon Devauchelle, Lucile Girard-Monneron, Mía Chávez Ruz, V. Chaddouk

A stimulus-organism-response model of willingness to buy from advertising speech using voice quality

Mizuki Nagano, Yusuke Ijima, Sadao Hiroya

Transfer Learning for Personality Perception via Speech Emotion Recognition

Yuanchao Li, Peter Bell, Catherine Lai

Effects of spectral and temporal modulation degradation on intelligibility and cortical tracking of speech signals

Ignacio Calderon De Palma, Laura S. Lopez, Alejandro Lopez Valdes

Effects of spectral degradation on the cortical tracking of the speech envelope

Alexis Deighton MacIntyre, Tobias Goehring

Tzu-Han Zoe Cheng, Kuan-Lin Chen, Juliane Schubert, Ya-Ping Chen, Tim Brown

Enhancing the EEG Speech Match Mismatch Tasks With Word Boundaries

Akshara Soman, Vidhi Sinha, Sriram Ganapathy

Exploring Auditory Attention Decoding using Speaker Features

Zelin Qiu, Jianjun Gu, Dingding Yao, Junfeng Li

Speech Taskonomy: Which Speech Tasks are the most Predictive of fMRI Brain Activity?

Subba Reddy Oota, Veeral Agarwal, Mounika Marreddy, Manish Gupta, Raju Bapi

Coherence Estimation Tracks Auditory Attention in Listeners with Hearing Impairment

Oskar Keding, Emina Alickovic, Martin A. Skoglund, Maria Sandsten

Investigating the cortical tracking of speech and music with sung speech

Giorgia Cantisani, Amirhossein Chalehchaleh, Giovanni Di Liberto, Shihab Shamma

MEG Encoding using Word Context Semantics in Listening Stories

Subba Reddy Oota, Nathan Trouvain, Frédéric Alexandre, Xavier Hinaut

Exploring a classification approach using quantised articulatory movements for acoustic to articulatory inversion

Jesuraj Bandekar, Sathvik Udupa, Prasanta Kumar Ghosh

Generating high-resolution 3D real-time MRI of the vocal tract

Martin Strauch, Antoine Serrurier

Learning to Compute the Articulatory Representations of Speech with the MIRRORNET

Yashish M Siriwardena, Carol Espy-Wilson, Shihab Shamma

Deep Speech Synthesis from MRI-Based Articulatory Representations

Peter Wu, Tingle Li, Yijing Lu, Yubin Zhang, Jiachen Lian

A GAN Speech Inpainting Model for Audio Editing Software

Haixin Zhao

Low-complexity Broadband Beampattern Synthesis using Array Response Control

Jiayi Xu, Jian Li, Weixin Meng, Xiaodong Li, Chengshi Zheng

Zoneformer: On-device Neural Beamformer For In-car Multi-zone Speech Separation, Enhancement and Echo Cancellation

Yong Xu, Vinay Kothapally, Meng Yu, Shixiong Zhang, Dong Yu

mdctGAN: Taming transformer-based GAN for speech super-resolution with Modified DCT spectra

Chenhao Shuai, Chaohua Shi, Lu Gan, Hongqing Liu

Noise-Robust Bandwidth Expansion for 8K Speech Recordings

Yin-Tse Lin, Bo-Hao Su, Chi-Han Lin, Shih-Chan Kuo, Jyh-Shing Roger Jang

Unsupervised speech enhancement with deep dynamical generative speech and noise models

Xiaoyu Lin, Simon Leglaive, Laurent Girin, Xavier Alameda-Pineda