Language Modeling

CDLM: Cross-Document Language Modeling EMNLP 2021 Character Transformations for Non-Autoregressive GEC Tagging EMNLP 2021 ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information ACL 2021 Chinese WPLC: A Chinese Dataset for Evaluating Pretrained Language Models on Word Prediction Given Long-Range Context EMNLP 2021 Class-Based Neural Network Language Model for Second-Pass Rescoring in ASR Interspeech 2021 Competency Problems: On Finding and Removing Artifacts in Language Data EMNLP 2021 Condenser: a Pre-training Architecture for Dense Retrieval EMNLP 2021 Constrained Language Models Yield Few-Shot Semantic Parsers EMNLP 2021 Context-aware Decoder for Neural Machine Translation using a Target-side Document-Level Language Model NAACL 2021 Contrasting distinct structured views to learn sentence embeddings EACL 2021 Controlled Evaluation of Grammatical Knowledge in Mandarin Chinese Language Models EMNLP 2021 Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterances ACL 2021 CoreLM: Coreference-aware Language Model Fine-Tuning EMNLP 2021 Corrected CBOW Performs as well as Skip-gram EMNLP 2021 Correcting Automated and Manual Speech Transcription Errors Using Warped Language Models Interspeech 2021 CS-BERT: a pretrained model for customer service dialogues EMNLP 2021 CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations EMNLP 2021 Data augmentation for low-resource grapheme-to-phoneme mapping ACL 2021 DeepBlueAI at SemEval-2021 Task 7: Detecting and Rating Humor and Offense with Stacking Diverse Language Model-Based Methods SemEval 2021 DeepRapper: Neural Rap Generation with Rhyme and Rhythm Modeling ACL 2021 Deriving Contextualised Semantic Features from BERT (and Other Transformer Model) Embeddings ACL 2021 DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts ACL 2021 Direction is what you need: Improving Word Embedding Compression in Large Language Models ACL 2021 Distilling Relation Embeddings from Pretrained Language Models EMNLP 2021 Distilling Word Meaning in Context from Pre-trained Language Models EMNLP 2021