Co-occurring keywords · papers mentioning both
Papers
Sparse maximal update parameterization: A holistic approach to sparse training dynamics
NeurIPS 2024
Speculative Contrastive Decoding
ACL 2024
SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms
ICML 2024
StableMask: Refining Causal Masking in Decoder-only Transformer
ICML 2024
Stay on Topic with Classifier-Free Guidance
ICML 2024
Subword Segmentation in LLMs: Looking at Inflection and Consistency
EMNLP 2024
SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
NeurIPS 2024
Test-Time Training on Nearest Neighbors for Large Language Models
ICLR 2024
That’s Optional: A Contemporary Exploration of “that” Omission in English Subordinate Clauses
ACL 2024
The Expressive Capacity of State Space Models: A Formal Language Perspective
NeurIPS 2024
The Role of n-gram Smoothing in the Age of Neural Networks
NAACL 2024
Tokenization via Language Modeling: the Role of Preceding Text
COLING 2024
Toward Efficient Inference for Mixture of Experts
NeurIPS 2024
Towards Comprehensive Language Analysis for Clinically Enriched Spontaneous Dialogue
COLING 2024
Towards Data-Efficient Language Models: A Child-Inspired Approach to Language Learning
CoNLL 2024
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
ICML 2024
Transformer-VQ: Linear-Time Transformers via Vector Quantization
ICLR 2024
UDParse @ SIGTYP 2024 Shared Task : Modern Language Models for Historical Languages
EACL 2024
Understanding Transformers via N-Gram Statistics
NeurIPS 2024
What Do Language Models Learn in Context? The Structured Task Hypothesis.
ACL 2024
When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages
EMNLP 2024
Why do LLaVA Vision-Language Models Reply to Images in English?
EMNLP 2024
Wikimedia data for AI: a review of Wikimedia datasets for NLP tasks and AI-assisted editing
EMNLP 2024
Word-level prediction in Plains Cree: First steps
NAACL 2024
XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection
ACL 2024