Language Models

ERNIE-Doc: A Retrospective Long-Document Modeling Transformer ACL 2021 Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach EMNLP 2021 Generate & Rank: A Multi-task Framework for Math Word Problems EMNLP 2021 Generating Datasets with Pretrained Language Models EMNLP 2021 GeneSis: A Generative Approach to Substitutes in Context EMNLP 2021 GooAQ: Open Question Answering with Diverse Answer Types EMNLP 2021 HateBERT: Retraining BERT for Abusive Language Detection in English ACL 2021 How effective is BERT without word ordering? Implications for language understanding and data privacy ACL 2021 How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models ACL 2021 How is BERT surprised? Layerwise detection of linguistic anomalies ACL 2021 How much pretraining data do language models need to learn syntax? EMNLP 2021 IGA: An Intent-Guided Authoring Assistant EMNLP 2021 Implicit Representations of Meaning in Neural Language Models ACL 2021 Improving the Diversity of Unsupervised Paraphrasing with Embedding Outputs EMNLP 2021 Is BERT a Cross-Disciplinary Knowledge Learner? A Surprising Finding of Pre-trained Models’ Transferability EMNLP 2021 IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization AAAI 2021 Japanese Zero Anaphora Resolution Can Benefit from Parallel Texts Through Neural Transfer Learning EMNLP 2021 jurBERT: A Romanian BERT Model for Legal Judgement Prediction EMNLP 2021 JuriBERT: A Masked-Language Model Adaptation for French Legal Text EMNLP 2021 KACE: Generating Knowledge Aware Contrastive Explanations for Natural Language Inference ACL 2021 KLMo: Knowledge Graph Enhanced Pretrained Language Model with Fine-Grained Relationships EMNLP 2021 Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases ACL 2021 K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce EMNLP 2021 KuiLeiXi: a Chinese Open-Ended Text Adventure Game ACL 2021 Language Model as an Annotator: Exploring DialoGPT for Dialogue Summarization ACL 2021