Large Language Models

On the Emergence of Position Bias in Transformers ICML 2025 On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention for Long-Context LLM Serving ICML 2025 On-the-fly Preference Alignment via Principle-Guided Decoding ICLR 2025 On the Generalization Ability of Next-Token-Prediction Pretraining ICML 2025 On the Influence of Context Size and Model Choice in Retrieval-Augmented Generation Systems NAACL 2025 On the Limit of Language Models as Planning Formalizers ACL 2025 On the Power of Context-Enhanced Learning in LLMs ICML 2025 On the Query Complexity of Verifier-Assisted Language Generation ICML 2025 On the Robustness of Agentic Function Calling NAACL 2025 On the Robustness of Reward Models for Language Model Alignment ICML 2025 On the Role of Key Phrases in Argument Mining NAACL 2025 On the Role of Model Prior in Real-World Inductive Reasoning EMNLP 2025 On the Same Wavelength? Evaluating Pragmatic Reasoning in Language Models across Broad Concepts EMNLP 2025 On the Tolerance of Repetition Before Performance Degradation in Kiswahili Automatic Speech Recognition ACL 2025 On the Training Convergence of Transformers for In-Context Classification of Gaussian Mixtures ICML 2025 On the Vulnerability of Applying Retrieval-Augmented Generation within Knowledge-Intensive Application Domains ICML 2025 On the Way to LLM Personalization: Learning to Remember User Conversations ACL 2025 On Understanding Attention-Based In-Context Learning for Categorical Data ICML 2025 On Zero-Initialized Attention: Optimal Prompt and Gating Factor Estimation ICML 2025 OpenNER 1.0: Standardized Open-Access Named Entity Recognition Datasets in 50+ Languages EMNLP 2025 OpenRLHF: A Ray-based Easy-to-use, Scalable and High-performance RLHF Framework EMNLP 2025 OpenS2S: Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model EMNLP 2025 Open-Set Living Need Prediction with Large Language Models ACL 2025 OpenworldAUC: Towards Unified Evaluation and Optimization for Open-world Prompt Tuning ICML 2025 Open-World Planning via Lifted Regression with LLM-Inferred Affordances for Embodied Agents ACL 2025