Language Models

Learn Your Tokens: Word-Pooled Tokenization for Language Modeling EMNLP 2023 LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development ACL 2023 Lifting the Curse of Capacity Gap in Distilling Language Models ACL 2023 Limitations of Language Models in Arithmetic and Symbolic Induction ACL 2023 Long-Range Language Modeling with Selective Cache EMNLP 2023 MIGA: A Unified Multi-Task Generation Framework for Conversational Text-to-SQL AAAI 2023 MixCE: Training Autoregressive Language Models by Mixing Forward and Reverse Cross-Entropies ACL 2023 mLongT5: A Multilingual and Efficient Text-To-Text Transformer for Longer Sequences EMNLP 2023 MolXPT: Wrapping Molecules with Text for Generative Pre-training ACL 2023 Monitor-Guided Decoding of Code LMs with Static Analysis of Repository Context NeurIPS 2023 MVP: Multi-task Supervised Pre-training for Natural Language Generation ACL 2023 Non-Autoregressive Document-Level Machine Translation EMNLP 2023 Non-Autoregressive Math Word Problem Solver with Unified Tree Structure EMNLP 2023 Not Enough Data to Pre-train Your Language Model? MT to the Rescue! ACL 2023 No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models NeurIPS 2023 On Pre-training Language Model for Antibody ICLR 2023 On the Impact of Cross-Domain Data on German Language Models EMNLP 2023 On the Surprising Effectiveness of Name Matching Alone in Autoregressive Entity Linking ACL 2023 PairSpanBERT: An Enhanced Language Model for Bridging Resolution ACL 2023 PLMmark: A Secure and Robust Black-Box Watermarking Framework for Pre-trained Language Models AAAI 2023 PREADD: Prefix-Adaptive Decoding for Controlled Text Generation ACL 2023 Pre-trained language models in Spanish for health insurance coverage ACL 2023 Pre-trained Personalized Review Summarization with Effective Salience Estimation ACL 2023 Pre-Training to Learn in Context ACL 2023 Prompting Language Models for Linguistic Structure ACL 2023