Rongjie Huang
48 papers · 2021–2025 · 10 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+10 more ↓ Show less ↑
π£ Hot Topic Early Bird π Conference Polyglot Β· Gold π Interdisciplinary Bridge Β· Silver πΊοΈ Taxonomy Completionist (58) π₯ Mega-Team Β· Squad
π
Grand Slam
π₯
Mega-Team Β· Squad
π€
Dynamic Duo
(44)
π¬
Deep Specialist
(23)
π
Renaissance Researcher
(5)
π₯
Unstoppable Β· Bronze
π
Century Club Β· Bronze
β
The Questioner
ποΈ
Keyword Collector
(205)
β‘
Prolific Year Β· Absurd
Venues
Top co-authors
Research topics
Deep Learning
(34)
Artificial Intelligence
(27)
Machine Learning
(27)
Core AI
(27)
Models
(21)
Speech & Audio
(19)
Learning Types Β· Deep Learning
(17)
Synthesis
(16)
Learning Types Β· Machine Learning
(15)
Core Methods
(10)
Architectures
(9)
Natural Language Processing
(8)
Computer Vision
(7)
Application Areas
(7)
Generation
(5)
Keywords
speech synthesis
(11)
singing voice synthesis
(9)
diffusion model
(6)
multimodal learning
(5)
self-supervised learning
(5)
contrastive learning
(5)
voice conversion
(4)
zero-shot learning
(4)
large language model
(4)
diffusion transformer
(4)
style transfer
(4)
generative model
(4)
speech-to-speech translation
(4)
cross-modal alignment
(3)
discrete representation
(3)
flow matching
(3)
cross-modal learning
(3)
self-supervised pretraining
(2)
multimodal representation
(2)
audio-visual speech
(2)
Papers
FlashAudio: Rectified Flow for Fast and High-Fidelity Text-to-Audio Generation
ACL 2025
Integrating Audio, Visual, and Semantic Information for Enhanced Multimodal Speaker Diarization on Multi-party Conversation
ACL 2025
Lumina-T2X: Scalable Flow-based Large Diffusion Transformer for Flexible Resolution Generation
ICLR 2025
OmniAudio: Generating Spatial Audio from 360-Degree Video
ICML 2025
OmniBind: Large-scale Omni Multimodal Representation via Binding Spaces
ICLR 2025
OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup
ICLR 2025
TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching
AAAI 2025
Versatile Framework for Song Generation with Prompt-based Control
EMNLP 2025
VoxDialogue: Can Spoken Dialogue Systems Understand Information Beyond Words?
ICLR 2025
WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling
ICLR 2025
AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head
AAAI 2024
Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers
NeurIPS 2024
Extending Multi-modal Contrastive Representations
NeurIPS 2024
FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion
ICML 2024
Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching
NeurIPS 2024
InstructSpeech: Following Speech Editing Instructions via Large Language Models
ICML 2024
Lumina-Next : Making Lumina-T2X Stronger and Faster with Next-DiT
NeurIPS 2024
Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners
ACL 2024
MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes
NeurIPS 2024
MoMu-Diffusion: On Learning Long-Term Motion-Music Synchronization and Correspondence
NeurIPS 2024
Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt
NAACL 2024
Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis
ICLR 2024
Robust Singing Voice Transcription Serves Synthesis
ACL 2024
Self-Supervised Singing Voice Pre-Training towards Speech-to-Singing Conversion
ACL 2024
Speech-to-Speech Translation with Discrete-Unit-Based Style Transfer
ACL 2024
StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesis
AAAI 2024
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control
EMNLP 2024
Text-to-Song: Towards Controllable Music Generation Incorporating Vocal and Accompaniment
ACL 2024
TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation
ACL 2024
UniAudio 1.5: Large Language Model-Driven Audio Codec is A Few-Shot Audio Task Learner
NeurIPS 2024
UniAudio: Towards Universal Audio Generation with Large Language Models
ICML 2024
Wav2SQL: Direct Generalizable Speech-To-SQL Parsing
ACL 2024
AlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignment
ACL 2023
AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation
ACL 2023
CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training
ACL 2023
Contrastive Token-Wise Meta-Learning for Unseen Performer Visual Temporal-Aligned Translation
ACL 2023
FastDiff 2: Revisiting and Incorporating GANs and Diffusion Models in High-Fidelity Speech Synthesis
ACL 2023
FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models
ACL 2023
Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models
ICML 2023
MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition
ICCV 2023
Prosody-TTS: Improving Prosody with Masked Autoencoder and Conditional Diffusion Model For Expressive Text-to-Speech
ACL 2023
RMSSinger: Realistic-Music-Score based Singing Voice Synthesis
ACL 2023
TranSpeech: Speech-to-Speech Translation With Bilateral Perturbation
ICLR 2023
ViT-TTS: Visual Text-to-Speech with Scalable Diffusion Transformer
EMNLP 2023
FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis
IJCAI 2022
GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speech
NeurIPS 2022
M4Singer: A Multi-Style, Multi-Singer and Musical Score Provided Mandarin Singing Corpus
NeurIPS 2022
EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model
Interspeech 2021