Large Language Models

K-BERT: Enabling Language Representation with Knowledge Graph AAAI 2020 KDE SenseForce at SemEval-2020 Task 4: Exploiting BERT for Commonsense Validation and Explanation SemEval 2020 KLEJ: Comprehensive Benchmark for Polish Language Understanding ACL 2020 Knowledge Distillation from Internal Representations AAAI 2020 Knowledge-Grounded Dialogue Generation with Pre-trained Language Models EMNLP 2020 Kungfupanda at SemEval-2020 Task 12: BERT-Based Multi-TaskLearning for Offensive Language Detection SemEval 2020 Language Models as Fact Checkers? ACL 2020 Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling EMNLP 2020 Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge NeurIPS 2020 Learning and Evaluating Contextual Embedding of Source Code ICML 2020 Learning Music Helps You Read: Using Transfer to Study Linguistic Structure in Language Models EMNLP 2020 Lee at SemEval-2020 Task 12: A BERT Model Based on the Maximum Self-ensemble Strategy for Identifying Offensive Language SemEval 2020 Linguistically-Informed Transformations (LIT): A Method for Automatically Generating Contrast Sets EMNLP 2020 LIORI at the FinCausal 2020 Shared task COLING 2020 Liputan6: A Large-scale Indonesian Dataset for Text Summarization AACL 2020 LRG at SemEval-2020 Task 7: Assessing the Ability of BERT and Derivative Models to Perform Short-Edits Based Humor Grading SemEval 2020 LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention EMNLP 2020 Masked Reasoner at SemEval-2020 Task 4: Fine-Tuning RoBERTa for Commonsense Reasoning SemEval 2020 Masking as an Efficient Alternative to Finetuning for Pretrained Language Models EMNLP 2020 MedDialog: Large-scale Medical Dialogue Datasets EMNLP 2020 MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models EMNLP 2020 MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers NeurIPS 2020 Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models ICLR 2020 MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices ACL 2020 MPNet: Masked and Permuted Pre-training for Language Understanding NeurIPS 2020