Shujie LIU

Shanks: Simultaneous Hearing and Thinking for Spoken Language Models ACL 2026 AutoGraph-R1: End-to-End Reinforcement Learning for Knowledge Graph Construction ACL 2026 Closing the Modality Reasoning Gap for Speech Large Language Models ACL 2026 SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluation ACL 2026 ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generation ICLR 2025 TrInk: Ink Generation with Transformer Network EMNLP 2025 Autoregressive Speech Synthesis without Vector Quantization ACL 2025 SLAM-Omni: Timbre-Controllable Voice Interaction System with Single-Stage Training ACL 2025 TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation NIPS 2024 CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations NIPS 2024 COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning INTERSPEECH 2024 WavLLM: Towards Robust and Adaptive Speech Large Language Model EMNLP 2024 GRAVO: Learning to Generate Relevant Audio from Visual Features with Noisy Online Videos INTERSPEECH 2023 Accelerating Transducers through Adjacent Token Merging INTERSPEECH 2023 LAMASSU: A Streaming Language-Agnostic Multilingual Speech Recognition and Translation Model Using Neural Transducers INTERSPEECH 2023 ComSL: A Composite Speech-Language Model for End-to-End Speech-to-Text Translation NIPS 2023 BEATs: Audio Pre-Training with Acoustic Tokenizers ICML 2023 Speech Pre-training with Acoustic Piece INTERSPEECH 2022 SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training EMNLP 2022 Two-Stream Network for Sign Language Recognition and Translation NIPS 2022 Separating Long-Form Speech with Group-wise Permutation Invariant Training INTERSPEECH 2022 Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition? INTERSPEECH 2022 Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data INTERSPEECH 2022 Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training INTERSPEECH 2022 SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing ACL 2022 SemFace: Pre-training Encoder and Decoder with a Semantic Interface for Neural Machine Translation ACL 2021 Grammar-Based Patches Generation for Automated Program Repair ACL 2021 UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Data ICML 2021 Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation EMNLP 2021 Jointly Learning to Repair Code and Generate Commit Message EMNLP 2021 Investigation of Practical Aspects of Single Channel Speech Separation for ASR INTERSPEECH 2021 Ultra Fast Speech Separation Model with Teacher Student Learning INTERSPEECH 2021 Grammar-Based Patches Generation for Automated Program Repair IJCNLP 2021 SemFace: Pre-training Encoder and Decoder with a Semantic Interface for Neural Machine Translation IJCNLP 2021 GraphCodeBERT: Pre-training Code Representations with Data Flow ICLR 2021 Improving Multilingual Transformer Transducer Models by Reducing Language Confusions INTERSPEECH 2021 A Dataset for Low-Resource Stylized Sequence-to-Sequence Generation AAAI 2020 RobuTrans: A Robust Transformer-Based Text-to-Speech Model AAAI 2020 Bridging the Gap between Pre-Training and Fine-Tuning for End-to-End Speech Translation AAAI 2020 MuTual: A Dataset for Multi-Turn Dialogue Reasoning ACL 2020 A Graph-based Coarse-to-fine Method for Unsupervised Bilingual Lexicon Induction ACL 2020 A Retrieve-and-Rewrite Initialization Method for Unsupervised Machine Translation ACL 2020 Curriculum Pre-training for End-to-End Speech Translation ACL 2020 On the Comparison of Popular End-to-End Models for Large Scale Speech Recognition INTERSPEECH 2020 Semantic Mask for Transformer Based End-to-End Speech Recognition INTERSPEECH 2020 Low Latency End-to-End Streaming Speech Recognition with a Scout Network INTERSPEECH 2020 MoBoAligner: A Neural Alignment Model for Non-Autoregressive TTS with Monotonic Boundary Search INTERSPEECH 2020 Explicit Cross-lingual Pre-training for Unsupervised Machine Translation EMNLP 2019 Regularizing Neural Machine Translation by Target-Bidirectional Agreement AAAI 2019 Unsupervised Neural Machine Translation with SMT as Posterior Regularization AAAI 2019 Neural Speech Synthesis with Transformer Network AAAI 2019 Unsupervised Context Rewriting for Open Domain Conversation EMNLP 2019 Explicit Cross-lingual Pre-training for Unsupervised Machine Translation IJCNLP 2019 Unsupervised Context Rewriting for Open Domain Conversation IJCNLP 2019 Triangular Architecture for Rare Language Translation ACL 2018 Bidirectional Generative Adversarial Networks for Neural Machine Translation CONLL 2018 Generative Bridging Network for Neural Sequence Prediction NAACL 2018 Learning to Collaborate for Question Answering and Asking NAACL 2018 Stack-based Multi-layer Attention for Transition-based Dependency Parsing EMNLP 2017 Chunk-based Decoder for Neural Machine Translation ACL 2017 Improving Attention Modeling with Implicit Distortion and Fertility for Machine Translation COLING 2016 Knowledge-Based Semantic Embedding for Machine Translation ACL 2016 Hierarchical Recurrent Neural Network for Document Modeling EMNLP 2015 Learning Topic Representation for SMT with Neural Networks ACL 2014 Bilingually-constrained Phrase Embeddings for Machine Translation ACL 2014 A Recursive Recurrent Neural Network for Statistical Machine Translation ACL 2014 Multi-Domain Adaptation for SMT Using Multi-Task Learning EMNLP 2013 Bilingual Data Cleaning for SMT using Graph-based Random Walk ACL 2013 Learning Entity Representation for Entity Disambiguation ACL 2013 Word Alignment Modeling with Context Dependent Deep Neural Network ACL 2013 Efficient Collective Entity Linking with Stacking EMNLP 2013 Re-training Monolingual Parser Bilingually for Syntactic SMT EMNLP 2012 Re-training Monolingual Parser Bilingually for Syntactic SMT CONLL 2012 Learning Translation Consensus with Structured Label Propagation ACL 2012 Transductive Minimum Error Rate Training for Statistical Machine Translation IJCNLP 2011 Improved Discriminative ITG Alignment using Hierarchical Phrase Pairs and Semi-supervised Training COLING 2010 Discriminative Pruning for Discriminative ITG Alignment ACL 2010 Diagnostic Evaluation of Machine Translation Systems Using Automatically Constructed Linguistic Check-Points COLING 2008