Large Language Models

CoLAKE: Contextualized Language and Knowledge Embedding COLING 2020 Cold-start Active Learning through Self-supervised Language Modeling EMNLP 2020 COMET: A Neural Framework for MT Evaluation EMNLP 2020 Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformers EMNLP 2020 Commonsense Reasoning for Natural Language Processing ACL 2020 Confidence Measure for Speech-to-Concept End-to-End Spoken Language Understanding Interspeech 2020 Context Analysis for Pre-trained Masked Language Models EMNLP 2020 Contextual BERT: Conditioning the Language Model Using a Global State COLING 2020 Contextual Embeddings for Arabic-English Code-Switched Data COLING 2020 ConvBERT: Improving BERT with Span-based Dynamic Convolution NeurIPS 2020 CosMo: Conditional Seq2Seq-based Mixture Model for Zero-Shot Commonsense Question Answering COLING 2020 Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media EMNLP 2020 Cross-Thought for Sentence Encoder Pre-training EMNLP 2020 Data Annealing for Informal Language Understanding Tasks EMNLP 2020 DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference ACL 2020 DEEPYANG at SemEval-2020 Task 4: Using the Hidden Layer State of BERT Model for Differentiating Common Sense SemEval 2020 Designing Templates for Eliciting Commonsense Knowledge from Pretrained Sequence-to-Sequence Models COLING 2020 DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation ACL 2020 Discourse structure interacts with reference but not syntax in neural language models CoNLL 2020 Distilling Knowledge Learned in BERT for Text Generation ACL 2020 Distilling the Knowledge of BERT for Sequence-to-Sequence ASR Interspeech 2020 Document-Level Neural Machine Translation Using BERT as Context Encoder AACL 2020 Does Chinese BERT Encode Word Structure? COLING 2020 Do Language Embeddings capture Scales? EMNLP 2020 Domain adaptation challenges of BERT in tokenization and sub-word representations of Out-of-Vocabulary words EMNLP 2020