Interspeech 2023

1,141 papers

Boosting Punctuation Restoration with Data Generation and Reinforcement Learning

Viet Dac Lai, Abel Salinas, Hao Tan, Trung Bui, Quan Tran

Rethinking Transfer and Auxiliary Learning for Improving Audio Captioning Transformer

WooSeok Shin, Hyun Joon Park, Jin Sob Kim, Dongwon Kim, Seungjin Lee

Improving Zero-shot Cross-domain Slot Filling via Transformer-based Slot Semantics Fusion

Yuhang Li, Xiao Wei, Yuke Si, Longbiao Wang, Xiaobao Wang

CN-Celeb-AV: A Multi-Genre Audio-Visual Dataset for Person Recognition

Lantian Li, Xiaolou Li, Haoyu Jiang, Chen Chen, Ruihai Hou

MAVD: The First Open Large-Scale Mandarin Audio-Visual Dataset with Depth Information

Jianrong Wang, Yuchen Huo, Li Liu, Tianyi Xu, Qi Li

Cross-utterance Conditioned Coherent Speech Editing

Cheng Yu, Yang Li, Weiqin Zu, Fanglei Sun, Zheng Tian

Reverberation-Controllable Voice Conversion Using Reverberation Time Estimator

Yeonjong Choi, Chao Xie, Tomoki Toda

ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and Speed

Meiying Chen, Zhiyao Duan

Emo-StarGAN: A Semi-Supervised Any-to-Many Non-Parallel Emotion-Preserving Voice Conversion

Suhita Ghosh, Arnab Das, Yamini Sinha, Ingo Siegert, Tim Polzehl

VC-T: Streaming Voice Conversion Based on Neural Transducer

Hiroki Kanagawa, Takafumi Moriya, Yusuke Ijima

Decoupling Segmental and Prosodic Cues of Non-native Speech through Vector Quantization

Waris Quamer, Anurag Das, Ricardo Gutierrez-Osuna

Evaluating and reducing the distance between synthetic and real speech distributions

Christoph Minixhofer, Ondrej Klejch, Peter Bell

ALO-VC: Any-to-any Low-latency One-shot Voice Conversion

Bohan Wang, Damien Ronssin, Milos Cernak

Attention-based Interactive Disentangling Network for Instance-level Emotional Voice Conversion

Yun Chen, Lingxiao Yang, Qi Chen, Jian-Huang Lai, Xiaohua Xie

DualVC: Dual-mode Voice Conversion using Intra-model Knowledge Distillation and Hybrid Predictive Coding

Ziqian Ning, Yuepeng Jiang, Pengcheng Zhu, Jixun Yao, Shuai Wang

CFVC: Conditional Filtering for Controllable Voice Conversion

Kou Tanaka, Takuhiro Kaneko, Hirokazu Kameoka, Shogo Seki

Voice Conversion With Just Nearest Neighbors

Matthew Baas, Benjamin Van Niekerk, Herman Kamper

DC CoMix TTS: An End-to-End Expressive TTS with Discrete Code Collaborated with Mixer

Yerin Choi, Myoung-Wan Koo

E2E-S2S-VC: End-To-End Sequence-To-Sequence Voice Conversion

Takuma Okamoto, Tomoki Toda, Hisashi Kawai

Exploiting Emotion Information in Speaker Embeddings for Expressive Text-to-Speech

Zein Shaheen, Tasnima Sadekova, Yulia Matveeva, Alexandra Shirshova, Mikhail Kudinov

Streaming Parrotron for on-device speech-to-speech conversion

Oleg Rybakov, Fadi Biadsy, Xia Zhang, Liyang Jiang, Phoenix Meadowlark

Mitigating the Exposure Bias in Sentence-Level Grapheme-to-Phoneme (G2P) Transduction

Eunseop Yoon, Hee Suk Yoon, Dhananjaya Gowda, SooHwan Eom, Daehyeok Kim

Application for Real-time Audio-Visual Speech Enhancement

Mandar Gogate, Kia Dashtipour, Amir Hussain

Data Augmentation for Diverse Voice Conversion in Noisy Environments

Avani Tanna, Michael Saxon, Amr El Abbadi, William Yang Wang

Real Time Detection of Soft Voice for Speech Enhancement

Hector A. Cordourier, Georg Stemmer, Sinem Aslan, Tobias Bocklet, Himanshu Bhalla

Show & Tell: Voice Activity Projection and Turn-taking

Erik Ekstedt, Gabriel Skantze

Comparing /b/ and /d/ with a Single Physical Model of the Human Vocal Tract to Visualize Droplets Produced while Speaking

Takayuki Arai, Tsukasa Yoshinaga, Akiyoshi Iida

So-to-Speak: An Exploratory Platform for Investigating the Interplay between Style and Prosody in TTS

Eva Szekely, Siyang Wang, Joakim Gustafson

Intonation Control for Neural Text-to-Speech Synthesis with Polynomial Models of F0

Niamh Corkey, Johannah O'Mahony, Simon King

Sp1NY: A Quick and Flexible Speech Visualisation Tool in Python

Sébastien Le Maguer, Mark Anderson, Naomi Harte

Nkululeko: Machine Learning Experiments on Speaker Characteristics Without Programming

Felix Burkhardt, Florian Eyben, Bjorn W. Schuller

DeepFilterNet: Perceptually Motivated Real-Time Speech Enhancement

Hendrik Schröter, Alberto N. Escalante-B., Tobias Rosenkranz, Andreas Maier

Dynamic Fully-Connected Layer for Large-Scale Speaker Verification

Zhida Song, Liang He, Baowei Zhao, Minqiang Xu, Yu Zheng

Improving Generalization Ability of Countermeasures for New Mismatch Scenario by Combining Multiple Advanced Regularization Terms

Chang Zeng, Xin Wang, Xiaoxiao Miao, Erica Cooper, Junichi Yamagishi

Multi-resolution Approach to Identification of Spoken Languages and To Improve Overall Language Diarization System Using Whisper Model

Bhavik Vachhani, Dipesh Singh, Rustom Lawyer

Model Compression for DNN-based Speaker Verification Using Weight Quantization

Jingyu Li, Wei Liu, Zhaoyang Zhang, Jiong Wang, Tan Lee

pyannote.audio 2.1 speaker diarization pipeline: principle, benchmark, and recipe

Hervé Bredin

Unsupervised Out-of-Distribution Dialect Detection with Mahalanobis Distance

Sourya Dipta Das, Yash Vadi, Abhishek Unnam, Kuldeep Yadav

Extremely Low Bit Quantization for Mobile Speaker Verification Systems Under 1MB Memory

Bei Liu, Haoyu Wang, Yanmin Qian

Self-supervised Learning Representation based Accent Recognition with Persistent Accent Memory

Rui Li, Zhiwei Xie, Haihua Xu, Yizhou Peng, Hexin Liu

HABLA: A Dataset of Latin American Spanish Accents for Voice Anti-spoofing

Pablo Andrés Tamayo Flórez, Rubén Manrique, Bernardo Pereira Nunes

A Parameter-Efficient Learning Approach to Arabic Dialect Identification with Pre-Trained General-Purpose Speech Model

Srijith Radhakrishnan, Chao-Han Huck Yang, Sumeer Ahmad Khan, Narsis A. Kiani, David Gomez-Cabrero

Wavelet Scattering Transform for Improving Generalization in Low-Resourced Spoken Language Identification

Spandan Dey, Premjeet Singh, Goutam Saha

Speaker Verification Across Ages: Investigating Deep Speaker Embedding Sensitivity to Age Mismatch in Enrollment and Test Speech

Vishwanath Pratap Singh, Md Sahidullah, Tomi Kinnunen

Branch-ECAPA-TDNN: A Parallel Branch Architecture to Capture Local and Global Features for Speaker Verification

Jiadi Yao, Chengdong Liang, Zhendong Peng, Binbin Zhang, Xiao-Lei Zhang

ACA-Net: Towards Lightweight Speaker Verification using Asymmetric Cross Attention

Jia Qi Yip, Duc-Tuan Truong, Dianwen Ng, Chong Zhang, Yukun Ma

Description and analysis of the KPT system for NIST Language Recognition Evaluation 2022

Salvatore Sarni, Sandro Cumani, Sabato Marco Siniscalchi, Andrea Bottino

The 2022 NIST Language Recognition Evaluation

Yooyoung Lee, Craig Greenberg, Eliot Godard, Asad A. Butt, Elliot Singer

What Can an Accent Identifier Learn? Probing Phonetic and Prosodic Information in a Wav2vec2-based Accent Identification Model

Mu Yang, Ram C. M. C. Shekar, Okim Kang, John H. L. Hansen

Vietnam-Celeb: a large-scale dataset for Vietnamese speaker recognition

Viet Thanh Pham, Xuan Thai Hoa Nguyen, Vu Hoang, Thi Thu Trang NGUYEN

Supervised Contrastive Learning with Nearest Neighbor Search for Speech Emotion Recognition

Xuechen Wang, Shiwan Zhao, Yong Qin

Learning Local to Global Feature Aggregation for Speech Emotion Recognition

Cheng Lu, Hailun Lian, Wenming Zheng, Yuan Zong, Yan Zhao

Transforming the Embeddings: A Lightweight Technique for Speech Emotion Recognition Tasks

Orchid Chetia Phukan, Arun Balaji Buduru, Rajesh Sharma

Preference Learning Labels by Anchoring on Consecutive Annotations

Abinay Reddy Naini, Ali N. Salman, Carlos Busso

Multi-Level Knowledge Distillation for Speech Emotion Recognition in Noisy Conditions

Yang Liu, Haoqin Sun, Geng Chen, Qingyue Wang, Zhen Zhao

Computation and Memory Efficient Noise Adaptation of Wav2Vec2.0 for Noisy Speech Emotion Recognition with Skip Connection Adapters

Seong-Gyun Leem, Daniel Fulford, Jukka-Pekka Onnela, David Gard, Carlos Busso

Implicit phonetic information modeling for speech emotion recognition

Tilak Purohit, Bogdan Vlasenko, Mathew Magimai.-Doss

Effects of perceived gender on the perceived social function of laughter

Joop Arts, Khiet P. Truong

What are differences? Comparing DNN and Human by Their Performance and Characteristics in Speaker Age Estimation

Yuki Kitagishi, Naohiro Tawara, Atsunori Ogawa, Ryo Masumura, Taichi Asami

Speaking State Decoder with Transition Detection for Next Speaker Prediction

Shao-Hao Lu, Yun-Shao Lin, Chi-Chun Lee

On the Efficacy and Noise-Robustness of Jointly Learned Speech Emotion and Automatic Speech Recognition

Lokesh Bansal, S. Pavankumar Dubagunta, Malolan Chetlur, Pushpak Jagtap, Aravind Ganapathiraju

SOT: Self-supervised Learning-Assisted Optimal Transport for Unsupervised Adaptive Speech Emotion Recognition

Ruiteng Zhang, Jianguo Wei, Xugang Lu, Yongwei Li, Junhai Xu

Towards Paralinguistic-Only Speech Representations for End-to-End Speech Emotion Recognition

Georgios Ioannides, Michael Owen, Andrew Fletcher, Viktor Rozgic, Chao Wang

Turbo your multi-modal classification with contrastive learning

Zhiyu Zhang, Da Liu, Shengqiang Liu, Anna Wang, Jie Gao

From Interval to Ordinal: A HMM based Approach for Emotion Label Conversion

Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah

Speaker Embeddings as Individuality Proxy for Voice Stress Detection

Zihan Wu, Neil Scheidwasser-Clow, Karl El Hajal, Milos Cernak

Lexical Stress and Velar Palatalization in Italian: A spatio-temporal Interaction

Bowei Shao, Philipp Buech, Anne Hermes, Maria Giavazzi

Increasing aspiration of word-medial fortis plosives in Swiss Standard German

Franka Zebe

Opening or Closing? An Electroglottographic Analysis of Voiceless Coda Consonants in Australian English

Louise Ratko, Joshua Penney, Felicity Cox

Segmental features of Brazilian (Santa Catarina) Hunsrik

Dennis Hoffmann, Maria O'Reilly

〈'〉 in Tsimane': a Preliminary Investigation

William N. Havard, Yaya Sy, Camila Scaff, Loann Peurey, Alejandrina Cristia

The emergence of obstruent-intrinsic f0 and VOT as cues to the fortis/lenis contrast in West Central Bavarian

Jasmin Pöhnlein, Felicitas Kleber

Perception of Incomplete Voicing Neutralization of Obstruents in Tohoku Japanese

Mafuyu Kitahara, Naoya Watabe, Hiroto Noguchi, Chuyu Huang, Ayako Hashimoto

Exploring the mutual intelligibility breakdown caused by sculpting speech from a competing speech signal

Martin Cooke, Maria Luisa Garcia Lecumberri

Predicting Perceptual Centers Located at Vowel Onset in German Speech Using Long Short-Term Memory Networks

Felicia Schulz, Mirella De Sisto, M. Paula Roncaglia-Denissen, Peter Hendrix

On the Benefits of Self-supervised Learned Speech Representations for Predicting Human Phonetic Misperceptions

Santiago Cuervo, Ricard Marxer

Quantifying Informational Masking due to Masker Intelligibility in Same-talker Speech-in-speech Perception

Mingyue Huo, Yinglun Sun, Dan Fogerty, Yan Tang

A neural architecture for selective attention to speech features

Nika Jurov, William Idsardi, Naomi H. Feldman

Whisper Encoder features for Infant Cry Classification

Monil Charola, Aastha Kachhi, Hemant A. Patil

Prediction of the Gender-based Violence Victim Condition using Speech: What do Machine Learning Models rely on?

Emma Reyner-Fuentes, Esther Rituerto-González, Isabel Trancoso, Carmen Peláez-Moreno

Respiratory distress estimation in human-robot interaction scenario

Eduardo Alvarado, Nicolás Grágeda, Alejandro Luzanto, Rodrigo Mahu, Jorge Wuth

Relationship between LTAS-based spectral moments and acoustic parameters of hypokinetic dysarthria in Parkinson’s disease

Jan Svihlik, Vojtěch Illner, Petr Kryze, Mário Sousa, Paul Krack

On-the-Fly Feature Based Rapid Speaker Adaptation for Dysarthric and Elderly Speech Recognition

Mengzhe Geng, Xurong Xie, Rongfeng Su, Jianwei Yu, Zengrui Jin

Automatic Assessment of Alzheimer's across Three Languages Using Speech and Language Features

Paula A. Pérez-Toro, Tomás Arias-Vergara, Franziska Braun, Florian Hönig, Carlos A. Tobón-Quintero

Active Learning for Abnormal Lung Sound Data Curation and Detection in Asthma

Shabnam Ghaffarzadegan, Luca Bondi, Ho-Hsiang Wu, Sirajum Munir, Kelly J. Shields

Classifying depression symptom severity: Assessment of speech representations in personalized and generalized machine learning models.

Edward L. Campbell, Judith Dineley, Pauline Conde, Faith Matcham, Katie M. White

Hyper-parameter Adaptation of Conformer ASR Systems for Elderly and Dysarthric Speech Recognition

Tianzi Wang, Shoukang Hu, Jiajun Deng, Zengrui Jin, Mengzhe Geng

Bayesian Networks for the robust and unbiased prediction of depression and its symptoms utilizing speech and multimodal data

Salvatore Fara, Orlaith Hickey, Alexandra Georgescu, Stefano Goria, Emilia Molimpakis

FTA-net: A Frequency and Time Attention Network for Speech Depression Detection

Qifei Li, Dong Wang, Yiming Ren, Yingming Gao, Ya Li

Capturing Mismatch between Textual and Acoustic Emotion Expressions for Mood Identification in Bipolar Disorder

Minxue Niu, Amrit Romana, Mimansa Jaiswal, Melvin McInnis, Emily Mower Provost

Integrated and Enhanced Pipeline System to Support Spoken Language Analytics for Screening Neurocognitive Disorders

Helen Meng, Brian Mak, Man-Wai Mak, Helene Fung, Xianmin Gong

Personalization for Robust Voice Pathology Detection in Sound Waves

Khanh-Tung Tran, Truong Hoang, Duy Khuong Nguyen, Hoang D. Nguyen, Xuan-Son Vu

An Automatic Multimodal Approach to Analyze Linguistic and Acoustic Cues on Parkinson's Disease Patients

Daniel Escobar-Grisales, Tomás Arias-Vergara, Cristian David Rios-Urrego, Elmar Nöth, Adolfo M. García

Background-Sound Controllable Voice Source Separation

Deokjun Eom, Woo Hyun Nam, Kyung-Rae Kim

Multi-Channel Speech Separation with Cross-Attention and Beamforming

Ladislav Mošner, Oldřich Plchot, Junyi Peng, Lukas Burget, Jan "Honza" Černocký

Recursive Sound Source Separation with Deep Learning-based Beamforming for Unknown Number of Sources

Hokuto Munakata, Ryu Takeda, Kazunori Komatani

CAPTDURE: Captioned Sound Dataset of Single Sources

Yuki Okamoto, Kanta Shimonishi, Keisuke Imoto, Kota Dohi, Shota Horiguchi

Remixing-based Unsupervised Source Separation from Scratch

Kohei Saijo, Tetsuji Ogawa

Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Model

Héctor Martel, Julius Richter, Kai Li, Xiaolin Hu, Timo Gerkmann

Adaptive Contextual Biasing for Transducer Based Streaming Speech Recognition

Tianyi Xu, Zhanheng Yang, Kaixun Huang, Pengcheng Guo, Ao Zhang