Language Models

Phonemer at WNUT-2020 Task 2: Sequence Classification Using COVID Twitter BERT and Bagging Ensemble Technique based on Plurality Voting EMNLP 2020 Plug-and-Play Conversational Models EMNLP 2020 Pretrained Language Model Embryology: The Birth of ALBERT EMNLP 2020 Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning ACL 2020 Pretraining with Contrastive Sentence Objectives Improves Discourse Performance of Language Models ACL 2020 Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order ACL 2020 RecoBERT: A Catalog Language Model for Text-Based Recommendations EMNLP 2020 Relevance-Promoting Language Model for Short-Text Conversation AAAI 2020 Residual Energy-Based Models for Text Generation ICLR 2020 SenseBERT: Driving Some Sense into BERT ACL 2020 SentiLARE: Sentiment-Aware Language Representation Learning with Linguistic Knowledge EMNLP 2020 Sparse Text Generation EMNLP 2020 StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding ICLR 2020 Structural and Functional Decomposition for Personality Image Captioning in a Communication Game EMNLP 2020 StyleDGPT: Stylized Response Generation with Pre-trained Language Models EMNLP 2020 TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data ACL 2020 Temporal Common Sense Acquisition with Minimal Supervision ACL 2020 The birth of Romanian BERT EMNLP 2020 The Curious Case of Neural Text Degeneration ICLR 2020 The EOS Decision and Length Extrapolation EMNLP 2020 The Sensitivity of Language Models and Humans to Winograd Schema Perturbations ACL 2020 This is a BERT. Now there are several of them. Can they generalize to novel words? EMNLP 2020 TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue EMNLP 2020 To Pretrain or Not to Pretrain: Examining the Benefits of Pretrainng on Resource Rich Tasks ACL 2020 Toward Micro-Dialect Identification in Diaglossic and Code-Switched Environments EMNLP 2020