Michael Zeng

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations NIPS 2024 Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks CVPR 2024 i-Code Studio: A Configurable and Composable Framework for Integrative AI EMNLP 2024 i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data NAACL 2024 TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation NIPS 2024 InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT EMNLP 2023 Automatic Prompt Optimization with “Gradient Descent” and Beam Search EMNLP 2023 Generate rather than Retrieve: Large Language Models are Strong Context Generators ICLR 2023 Any-to-Any Generation via Composable Diffusion NIPS 2023 ComSL: A Composite Speech-Language Model for End-to-End Speech-to-Text Translation NIPS 2023 i-Code: An Integrative and Composable Multimodal Learning Framework AAAI 2023 UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization ACL 2023 Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarization ACL 2023 Adapting Multi-Lingual ASR Models for Handling Multiple Talkers INTERSPEECH 2023 ReCo: Region-Controlled Text-to-Image Generation CVPR 2023 Unifying Vision, Text, and Layout for Universal Document Processing CVPR 2023 LMGQS: A Large-scale Dataset for Query-focused Summarization EMNLP 2023 Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention IJCAI 2022 JAKET: Joint Pre-training of Knowledge Graph and Language Understanding AAAI 2022 DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization AAAI 2022 Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data ACL 2022 KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering ACL 2022 End-to-End Segmentation-based News Summarization ACL 2022 Dict-BERT: Enhancing Language Model Pre-training with Dictionary ACL 2022 Leveraging Knowledge in Multilingual Commonsense Reasoning ACL 2022 An Empirical Study of Training End-to-End Vision-and-Language Transformers CVPR 2022 CLIP-Event: Connecting Text and Images With Event Structures CVPR 2022 ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation EMNLP 2022 Automatic Rule Induction for Efficient Semi-Supervised Learning EMNLP 2022 Narrate Dialogues for Better Summarization EMNLP 2022 Unsupervised Multi-Granularity Summarization EMNLP 2022 Task Compass: Scaling Multi-task Pre-training with Task Prefix EMNLP 2022 AdaPrompt: Adaptive Model Training for Prompt-based NLP EMNLP 2022 Visual Clues: Bridging Vision and Language Foundations for Image Paragraph Captioning NIPS 2022 SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding NAACL 2021 UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Data ICML 2021 Fusing Context Into Knowledge Graph for Commonsense Question Answering IJCNLP 2021 Retrieval Enhanced Model for Commonsense Generation IJCNLP 2021 Want To Reduce Labeling Cost? GPT-3 Can Help EMNLP 2021 Modeling Entity Knowledge for Fact Verification EMNLP 2021 Data Augmentation for Spoken Language Understanding via Pretrained Language Models INTERSPEECH 2021 Fusing Context Into Knowledge Graph for Commonsense Question Answering ACL 2021 Enhancing Factual Consistency of Abstractive Summarization NAACL 2021 MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization NAACL 2021 Retrieval Enhanced Model for Commonsense Generation ACL 2021 Sequence-Level Self-Learning with Multiple Hypotheses INTERSPEECH 2020 A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining EMNLP 2020 Few-shot Natural Language Generation for Task-Oriented Dialog EMNLP 2020 Discriminative Transfer Learning for Optimizing ASR and Semantic Labeling in Task-Oriented Spoken Dialog INTERSPEECH 2020 Mixed-Lingual Pre-training for Cross-lingual Summarization AACL 2020 TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising EMNLP 2020 Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue EMNLP 2019 Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue IJCNLP 2019 Meeting Transcription Using Asynchronous Distant Microphones INTERSPEECH 2019