← Keywords

language modeling

655 papers

Explore in graph

Also known as

NLM LM

Co-occurring keywords

language model (4573) text generation (2903) recurrent neural network (1790) large language model (12755) neural network (6616) transformer architecture (1555) representation learning (6174) attention mechanism (3975) machine translation (2472) automatic speech recognition (1764)

Papers

HMoE: Heterogeneous Mixture of Experts for Language Modeling EMNLP 2025
Why Are Positional Encodings Nonessential for Deep Autoregressive Transformers? A Petroglyph Revisited ACL 2025
Subword models struggle with word learning, but surprisal hides it ACL 2025
TriEmbed: Bridge the Gap between Text and Token Indices with Embedding Reparameterization ACL 2025
Deconstructing Attention: Investigating Design Principles for Effective Language Modeling IJCNLP 2025
Discrete Diffusion Language Model for Efficient Text Summarization NAACL 2025
Synthesising a Corpus of Gaelic Traditional Narrative with Cross-Lingual Text Expansion COLING 2025
On the Power of Convolution-Augmented Transformer AAAI 2025
Story Generation with Large Language Models for African Languages ACL 2025
DOGR: Leveraging Document-Oriented Contrastive Learning in Generative Retrieval AAAI 2025
Findings of the Second BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora CONLL 2024
XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection ACL 2024
A New Massive Multilingual Dataset for High-Performance Language Technologies COLING 2024
Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling ACL 2024
Towards Data-Efficient Language Models: A Child-Inspired Approach to Language Learning CONLL 2024
Comprehensive Study on German Language Models for Clinical and Biomedical Text Understanding COLING 2024
How Vocabulary Sharing Facilitates Multilingualism in LLaMA? ACL 2024
Chinese Spelling Correction as Rephrasing Language Model AAAI 2024
Mission: Impossible Language Models ACL 2024
REBEL: Reinforcement Learning via Regressing Relative Rewards NIPS 2024
On the Power of Decision Trees in Auto-Regressive Language Modeling NIPS 2024
Exploring the Benefits of Tokenization of Discrete Acoustic Units INTERSPEECH 2024
Toward Efficient Inference for Mixture of Experts NIPS 2024
Sparse maximal update parameterization: A holistic approach to sparse training dynamics NIPS 2024
Conceptual Pacts for Reference Resolution Using Small, Dynamically Constructed Language Models: A Study in Puzzle Building Dialogues COLING 2024