Natural Language Processing › Generation ›

Language Modeling

1624 directly classified papers

Papers per year

Papers

Reservoir Transformers ACL 2021

Structural Guidance for Transformer Language Models ACL 2021

PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction ACL 2021

Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation? EMNLP 2021

Noobs at Semeval-2021 Task 4: Masked Language Modeling for abstract answer prediction SEMEVAL 2021

ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract Meaning SEMEVAL 2021

Bilingual Alignment Pre-Training for Zero-Shot Cross-Lingual Transfer EMNLP 2021

Language Modelling as a Multi-Task Problem EACL 2021

Arabic Compact Language Modelling for Resource Limited Devices EACL 2021

AraGPT2: Pre-Trained Transformer for Arabic Language Generation EACL 2021

Explicit Tone Transcription Improves ASR Performance in Extremely Low-Resource Languages: A Case Study in Bribri NAACL 2021

EnsLM: Ensemble Language Model for Data Diversity by Semantic Clustering ACL 2021

Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases ACL 2021

Searching for Efficient Transformers for Language Modeling NIPS 2021

Sparse is Enough in Scaling Transformers NIPS 2021

Trading Off Diversity and Quality in Natural Language Generation EACL 2021

What Context Features Can Transformer Language Models Use? IJCNLP 2021

Structural Guidance for Transformer Language Models IJCNLP 2021

Surprisal Estimators for Human Reading Times Need Character Models IJCNLP 2021

Reservoir Transformers IJCNLP 2021

Improving Lexically Constrained Neural Machine Translation with Source-Conditioned Masked Span Prediction IJCNLP 2021

Cascaded Head-colliding Attention IJCNLP 2021

Prevent the Language Model from being Overconfident in Neural Machine Translation IJCNLP 2021

Language Model Evaluation Beyond Perplexity IJCNLP 2021

Shortformer: Better Language Modeling using Shorter Inputs IJCNLP 2021