language modeling

655 papers

Explore in graph

Also known as

NLM LM

Co-occurring keywords

language model (4573) text generation (2903) recurrent neural network (1790) large language model (12755) neural network (6616) transformer architecture (1555) representation learning (6174) attention mechanism (3975) machine translation (2472) automatic speech recognition (1764)

Papers

XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection ACL 2024

On the Effect of (Near) Duplicate Subwords in Language Modelling ACL 2024

An Analysis of Tokenization: Transformers under Markov Data NIPS 2024

One-Vs-Rest Neural Network English Grapheme Segmentation: A Linguistic Perspective CONLL 2024

ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training ACL 2024

BabyLM Challenge: Experimenting with Self-Distillation and Reverse-Distillation for Language Model Pre-Training on Constrained Datasets CONLL 2024

Exploring the Benefits of Tokenization of Discrete Acoustic Units INTERSPEECH 2024

Lexicon-Level Contrastive Visual-Grounding Improves Language Modeling ACL 2024

A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction Based on Large Language Models EMNLP 2024

From Partial to Strictly Incremental Constituent Parsing EACL 2024

EIT: Enhanced Interactive Transformer ACL 2024

FFF: Fixing Flawed Foundations in Contrastive Pre-Training Results in Very Strong Vision-Language Models CVPR 2024

Findings of the Second BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora CONLL 2024

REBEL: Reinforcement Learning via Regressing Relative Rewards NIPS 2024

Comparing a BERT Classifier and a GPT classifier for Detecting Connective Language Across Multiple Social Media EMNLP 2024

Birdie: Advancing State Space Language Modeling with Dynamic Mixtures of Training Objectives EMNLP 2024

Subword Segmentation in LLMs: Looking at Inflection and Consistency EMNLP 2024

Predictor-Corrector Enhanced Transformers with Exponential Moving Average Coefficient Learning NIPS 2024

Towards Data-Efficient Language Models: A Child-Inspired Approach to Language Learning CONLL 2024

Image as a Language: Revisiting Scene Text Recognition via Balanced, Unified and Synchronized Vision-Language Reasoning Network AAAI 2024

Phonetic Enhanced Language Modeling for Text-to-Speech Synthesis INTERSPEECH 2024

OLMo: Accelerating the Science of Language Models ACL 2024

Is Child-Directed Speech Effective Training Data for Language Models? EMNLP 2024

Algorithmic progress in language models NIPS 2024

Examining Language Modeling Assumptions Using an Annotated Literary Dialect Corpus EMNLP 2024