Language Models

Rethinking KenLM: Good and Bad Model Ensembles for Efficient Text Quality Filtering in Large Web Corpora ACL 2025 Scaling Laws for Multilingual Language Models ACL 2025 Scaling up Masked Diffusion Models on Text ICLR 2025 Scaling up the State Size of RNN LLMs for Long-Context Scenarios ACL 2025 Sequence to Sequence Reward Modeling: Improving RLHF by Language Feedback AAAI 2025 SOAP: Improving and Stabilizing Shampoo using Adam for Language Modeling ICLR 2025 Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling ICLR 2025 SR-LLM: Rethinking the Structured Representation in Large Language Model ACL 2025 Story Generation with Large Language Models for African Languages ACL 2025 Subjective Behaviors and Preferences in LLM: Language of Browsing EMNLP 2025 Surprising Effectiveness of pretraining Ternary Language Model at Scale ICLR 2025 TaxoAlign: Scholarly Taxonomy Generation Using Language Models EMNLP 2025 Temporal Scaling Law for Large Language Models EMNLP 2025 TEncDM: Understanding the Properties of the Diffusion Model in the Space of Language Model Encodings AAAI 2025 TESS 2: A Large-Scale Generalist Diffusion Language Model ACL 2025 Test-Time Steering for Lossless Text Compression via Weighted Product of Experts EMNLP 2025 The Inverse Scaling Effect of Pre-Trained Language Model Surprisal Is Not Due to Data Leakage ACL 2025 The Scene Language: Representing Scenes with Programs, Words, and Embeddings CVPR 2025 TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining ACL 2025 TLPIQ at BioLaySumm: Hide and Seq, a FLAN-T5 Model for Biomedical Summarization ACL 2025 TokAlign: Efficient Vocabulary Adaptation via Token Alignment ACL 2025 Tokenization and Representation Biases in Multilingual Models on Dialectal NLP Tasks EMNLP 2025 Token Prepending: A Training-Free Approach for Eliciting Better Sentence Embeddings from LLMs ACL 2025 Towards a Holistic and Automated Evaluation Framework for Multi-Level Comprehension of LLMs in Book-Length Contexts EMNLP 2025 Towards the Law of Capacity Gap in Distilling Language Models ACL 2025