Speech Synthesis

Cyclic Learning for Binaural Audio Generation and Localization CVPR 2024 DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation CVPR 2024 Emotion Arithmetic: Emotional Speech Synthesis via Weight Space Interpolation Interspeech 2024 Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling AAAI 2024 Faces that Speak: Jointly Synthesising Talking Face and Speech from Text CVPR 2024 FT-GAN: Fine-Grained Tune Modeling for Chinese Opera Synthesis AAAI 2024 G2P-DDM: Generating Sign Pose Sequence from Gloss Sequence with Discrete Diffusion Model AAAI 2024 IndicVoices-R: Unlocking a Massive Multilingual Multi-speaker Speech Corpus for Scaling Indian TTS NeurIPS 2024 Knowledge-Preserving Pluggable Modules for Multilingual Speech Translation Tasks Interspeech 2024 LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading ICLR 2024 Mimic: Speaking Style Disentanglement for Speech-Driven 3D Facial Animation AAAI 2024 On the Semantic Latent Space of Diffusion-Based Text-To-Speech Models ACL 2024 Production of phrases by mechanical models of the human vocal tract Interspeech 2024 PSLM: Parallel Generation of Text and Speech with LLMs for Low-Latency Spoken Dialogue Systems EMNLP 2024 Self-Supervised Singing Voice Pre-Training towards Speech-to-Singing Conversion ACL 2024 SelfVC: Voice Conversion With Iterative Refinement using Self Transformations ICML 2024 SpeechAlign: Aligning Speech Generation to Human Preferences NeurIPS 2024 Speechworthy Instruction-tuned Language Models EMNLP 2024 StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing ACL 2024 StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesis AAAI 2024 TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control EMNLP 2024 TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation ACL 2024 V2Meow: Meowing to the Visual Beat via Video-to-Music Generation AAAI 2024 VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wild ACL 2024 Word-Conditioned 3D American Sign Language Motion Generation EMNLP 2024