Skip to content
conftrace_

language modeling

723 papers

LM

Papers

Sparse maximal update parameterization: A holistic approach to sparse training dynamics NeurIPS 2024 Speculative Contrastive Decoding ACL 2024 SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms ICML 2024 StableMask: Refining Causal Masking in Decoder-only Transformer ICML 2024 Stay on Topic with Classifier-Free Guidance ICML 2024 Subword Segmentation in LLMs: Looking at Inflection and Consistency EMNLP 2024 SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention NeurIPS 2024 Test-Time Training on Nearest Neighbors for Large Language Models ICLR 2024 That’s Optional: A Contemporary Exploration of “that” Omission in English Subordinate Clauses ACL 2024 The Expressive Capacity of State Space Models: A Formal Language Perspective NeurIPS 2024 The Role of n-gram Smoothing in the Age of Neural Networks NAACL 2024 Tokenization via Language Modeling: the Role of Preceding Text COLING 2024 Toward Efficient Inference for Mixture of Experts NeurIPS 2024 Towards Comprehensive Language Analysis for Clinically Enriched Spontaneous Dialogue COLING 2024 Towards Data-Efficient Language Models: A Child-Inspired Approach to Language Learning CoNLL 2024 Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality ICML 2024 Transformer-VQ: Linear-Time Transformers via Vector Quantization ICLR 2024 UDParse @ SIGTYP 2024 Shared Task : Modern Language Models for Historical Languages EACL 2024 Understanding Transformers via N-Gram Statistics NeurIPS 2024 What Do Language Models Learn in Context? The Structured Task Hypothesis. ACL 2024 When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages EMNLP 2024 Why do LLaVA Vision-Language Models Reply to Images in English? EMNLP 2024 Wikimedia data for AI: a review of Wikimedia datasets for NLP tasks and AI-assisted editing EMNLP 2024 Word-level prediction in Plains Cree: First steps NAACL 2024 XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection ACL 2024