language modeling

655 papers

Explore in graph

Also known as

NLM LM

Co-occurring keywords

language model (4573) text generation (2903) recurrent neural network (1790) large language model (12755) neural network (6616) transformer architecture (1555) representation learning (6174) attention mechanism (3975) machine translation (2472) automatic speech recognition (1764)

Papers

Evaluating Large Language Models via Linguistic Profiling EMNLP 2024

CoELM: Construction-Enhanced Language Modeling ACL 2024

OLMo: Accelerating the Science of Language Models ACL 2024

What Do Language Models Learn in Context? The Structured Task Hypothesis. ACL 2024

Layer-Condensed KV Cache for Efficient Inference of Large Language Models ACL 2024

A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives EMNLP 2024

Comprehensive Study on German Language Models for Clinical and Biomedical Text Understanding COLING 2024

On the Power of Decision Trees in Auto-Regressive Language Modeling NIPS 2024

Consistent Bidirectional Language Modelling: Expressive Power and Representational Conciseness EMNLP 2024

A Thorough Examination of Decoding Methods in the Era of LLMs EMNLP 2024

RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content NIPS 2024

Sparse maximal update parameterization: A holistic approach to sparse training dynamics NIPS 2024

Conceptual Pacts for Reference Resolution Using Small, Dynamically Constructed Language Models: A Study in Puzzle Building Dialogues COLING 2024

REBEL: Reinforcement Learning via Regressing Relative Rewards NIPS 2024

Toward Efficient Inference for Mixture of Experts NIPS 2024

Findings of the Second BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora CONLL 2024

Exploring the Benefits of Tokenization of Discrete Acoustic Units INTERSPEECH 2024

BabyLM Challenge: Experimenting with Self-Distillation and Reverse-Distillation for Language Model Pre-Training on Constrained Datasets CONLL 2024

Learning Disentangled Semantic Spaces of Explanations via Invertible Neural Networks ACL 2024

Scaling Laws for Linear Complexity Language Models EMNLP 2024

PyramidCodec: Hierarchical Codec for Long-form Music Generation in Audio Domain EMNLP 2024

Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers AISTATS 2024

CheckersGPT: Learning World Models through Language Modeling ACL 2024

Speculative Contrastive Decoding ACL 2024

AgentTuning: Enabling Generalized Agent Abilities for LLMs ACL 2024