Language Modeling

A Survey of Quantum Natural Language Processing: From Compositional Models to NISQ-Era Empiricism AACL 2025 A Survey to Recent Progress Towards Understanding In-Context Learning NAACL 2025 A Systematic Study of Compositional Syntactic Transformer Language Models ACL 2025 A Tale of Two Structures: Do LLMs Capture the Fractal Complexity of Language? ICML 2025 Attention-Level Speculation ICML 2025 Audio Large Language Models Can Be Descriptive Speech Quality Evaluators ICLR 2025 AutoDSPy: Automating Modular Prompt Design with Reinforcement Learning for Small and Large Language Models EMNLP 2025 A Variational Framework for Improving Naturalness in Generative Spoken Language Models ICML 2025 Babies Learn to Look Ahead: Multi-Token Prediction in Small LMs EMNLP 2025 BabyLM’s First Constructions: Causal interventions provide a signal of learning EMNLP 2025 BabyLM’s First Words: Word Segmentation as a Phonological Probing Task CoNLL 2025 BabyLMs for isiXhosa: Data-Efficient Language Modelling in a Low-Resource Context COLING 2025 Babysit A Language Model From Scratch: Interactive Language Learning by Trials and Demonstrations NAACL 2025 bAI-bAI: A Context-Aware Transliteration System for Baybayin Scripts COLING 2025 Batch-wise Convergent Pre-training: Step-by-Step Learning Inspired by Child Language Development EMNLP 2025 BehaviorBox: Automated Discovery of Fine-Grained Performance Differences Between Language Models ACL 2025 Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases ACL 2025 Beyond Cairo: Sa’idi Egyptian Arabic Literary Corpus Construction and Analysis NAACL 2025 Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMs COLING 2025 Beyond Distribution: Investigating Language Models’ Understanding of Sino-Korean Morphemes EMNLP 2025 Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verification ICLR 2025 Beyond Next Token Prediction: Patch-Level Training for Large Language Models ICLR 2025 Beyond Repetition: Text Simplification and Curriculum Learning for Data-Constrained Pretraining EMNLP 2025 Beyond Text Compression: Evaluating Tokenizers Across Scales ACL 2025 Beyond the Spelling Miracle: Investigating Substring Awareness in Character-Blind Language Models ACL 2025