Language Modeling

On the In-context Generation of Language Models EMNLP 2024 On the Inductive Bias of Stacking Towards Improving Reasoning NeurIPS 2024 On the Power of Decision Trees in Auto-Regressive Language Modeling NeurIPS 2024 On the Proper Treatment of Tokenization in Psycholinguistics EMNLP 2024 On the Role of Context in Reading Time Prediction EMNLP 2024 On the token distance modeling ability of higher RoPE attention dimension EMNLP 2024 Open foundation models for Azerbaijani language ACL 2024 OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset NeurIPS 2024 Open-RAG: Enhanced Retrieval Augmented Reasoning with Open-Source Large Language Models EMNLP 2024 Optimising LLM-Driven Machine Translation with Context-Aware Sliding Windows EMNLP 2024 Optimizing Language Models with Fair and Stable Reward Composition in Reinforcement Learning EMNLP 2024 Optimizing Watermarks for Large Language Models ICML 2024 Order-Independence Without Fine Tuning NeurIPS 2024 OtoBERT: Identifying Suffixed Verbal Forms in Modern Hebrew Literature EMNLP 2024 Paloma: A Benchmark for Evaluating Language Model Fit NeurIPS 2024 Parallelizing Linear Transformers with the Delta Rule over Sequence Length NeurIPS 2024 Parrot: Enhancing Multi-Turn Instruction Following for Large Language Models ACL 2024 Perceptions of Linguistic Uncertainty by Language Models and Humans EMNLP 2024 Perplexing Canon: A study on GPT-based perplexity of canonical and non-canonical literary works EACL 2024 Phonetic Enhanced Language Modeling for Text-to-Speech Synthesis Interspeech 2024 PIDformer: Transformer Meets Control Theory ICML 2024 PolySketchFormer: Fast Transformers via Sketching Polynomial Kernels ICML 2024 PolyVoice: Language Models for Speech to Speech Translation ICLR 2024 Position: A Roadmap to Pluralistic Alignment ICML 2024 Position: Do pretrained Transformers Learn In-Context by Gradient Descent? ICML 2024