Natural Language Processing › Generation ›

Language Modeling

1624 directly classified papers

Papers per year

Papers

ERNIE-Doc: A Retrospective Long-Document Modeling Transformer ACL 2021

R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling ACL 2021

Language Model Evaluation Beyond Perplexity ACL 2021

Shortformer: Better Language Modeling using Shorter Inputs ACL 2021

The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models ACL 2021

Data augmentation for low-resource grapheme-to-phoneme mapping ACL 2021

AugNLG: Few-shot Natural Language Generation using Self-trained Data Augmentation ACL 2021

Adapting Long Context NLM for ASR Rescoring in Conversational Agents INTERSPEECH 2021

Language Modeling and Artificial Intelligence INTERSPEECH 2021

Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories EMNLP 2021

Efficient Contrastive Learning via Novel Data Augmentation and Curriculum Learning EMNLP 2021

You should evaluate your language model on marginal likelihood over tokenisations EMNLP 2021

Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little EMNLP 2021

Frustratingly Simple Pretraining Alternatives to Masked Language Modeling EMNLP 2021

Chinese WPLC: A Chinese Dataset for Evaluating Pretrained Language Models on Word Prediction Given Long-Range Context EMNLP 2021

CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations EMNLP 2021

IGA: An Intent-Guided Authoring Assistant EMNLP 2021

Inducing Transformer’s Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks EMNLP 2021

When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute EMNLP 2021

Value-aware Approximate Attention EMNLP 2021

“Was it “stated” or was it “claimed”?: How linguistic bias affects generative language models EMNLP 2021

Studying word order through iterative shuffling EMNLP 2021

Reconsidering the Past: Optimizing Hidden States in Language Models EMNLP 2021

Noobs at Semeval-2021 Task 4: Masked Language Modeling for abstract answer prediction ACL 2021

PINGAN Omini-Sinitic at SemEval-2021 Task 4:Reading Comprehension of Abstract Meaning ACL 2021