language modeling

655 papers

Explore in graph

Also known as

NLM LM

Co-occurring keywords

language model (4573) text generation (2903) recurrent neural network (1790) large language model (12755) neural network (6616) transformer architecture (1555) representation learning (6174) attention mechanism (3975) machine translation (2472) automatic speech recognition (1764)

Papers

Selective Attention: Enhancing Transformer through Principled Context Control NIPS 2024

On the Power of Decision Trees in Auto-Regressive Language Modeling NIPS 2024

Mission: Impossible Language Models ACL 2024

REPLUG: Retrieval-Augmented Black-Box Language Models NAACL 2024

The Expressive Capacity of State Space Models: A Formal Language Perspective NIPS 2024

Towards Data-Efficient Language Models: A Child-Inspired Approach to Language Learning CONLL 2024

Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling ACL 2024

Speculative Contrastive Decoding ACL 2024

Image as a Language: Revisiting Scene Text Recognition via Balanced, Unified and Synchronized Vision-Language Reasoning Network AAAI 2024

Chinese Spelling Correction as Rephrasing Language Model AAAI 2024

Cached Transformers: Improving Transformers with Differentiable Memory Cachde AAAI 2024

FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data EMNLP 2024

PyramidCodec: Hierarchical Codec for Long-form Music Generation in Audio Domain EMNLP 2024

Is Child-Directed Speech Effective Training Data for Language Models? EMNLP 2024

How Vocabulary Sharing Facilitates Multilingualism in LLaMA? ACL 2024

Hyper-QKSG: Framework for Automating Query Generation and Knowledge-Snippet Extraction from Tables and Lists EMNLP 2024

XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection ACL 2024

On the Effect of (Near) Duplicate Subwords in Language Modelling ACL 2024

Sparse maximal update parameterization: A holistic approach to sparse training dynamics NIPS 2024

Neurocache: Efficient Vector Retrieval for Long-range Language Modeling NAACL 2024

ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training ACL 2024

A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives EMNLP 2024

Diffusion Guided Language Modeling ACL 2024

Anisotropy is Not Inherent to Transformers NAACL 2024

Scaling Laws for Linear Complexity Language Models EMNLP 2024