Language Modeling

Understanding Transformers via N-Gram Statistics NeurIPS 2024 Unlabeled Debiasing in Downstream Tasks via Class-wise Low Variance Regularization EMNLP 2024 Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback NeurIPS 2024 Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance ACL 2024 Unsupervised Human Preference Learning EMNLP 2024 Using a Language Model to Unravel Semantic Development in Children’s Use of a Dutch Perception Verb COLING 2024 Using Curriculum Masking Based on Child Language Development to Train a Large Language Model with Limited Training Data CoNLL 2024 Using Discourse Connectives to Test Genre Bias in Masked Language Models EACL 2024 Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties AAAI 2024 Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention ICML 2024 VideoCon: Robust Video-Language Alignment via Contrast Captions CVPR 2024 VideoPoet: A Large Language Model for Zero-Shot Video Generation ICML 2024 Virtual Personas for Language Models via an Anthology of Backstories EMNLP 2024 Watermarks in the Sand: Impossibility of Strong Watermarking for Language Models ICML 2024 Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models NeurIPS 2024 What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages ACL 2024 What Matters in Memorizing and Recalling Facts? Multifaceted Benchmarks for Knowledge Probing in Language Models EMNLP 2024 What should Baby Models read? Exploring Sample-Efficient Data Composition on Model Performance CoNLL 2024 When do Generative Query and Document Expansions Fail? A Comprehensive Study Across Methods, Retrievers, and Datasets EACL 2024 When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages EMNLP 2024 When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models ICML 2024 Where is the signal in tokenization space? EMNLP 2024 Whitening Not Recommended for Classification Tasks in LLMs ACL 2024 Why Generate When You Can Discriminate? A Novel Technique for Text Classification using Language Models EACL 2024 WizardLM: Empowering Large Pre-Trained Language Models to Follow Complex Instructions ICLR 2024