Large Language Models

Leveraging Pre-Trained Language Model for Speech Sentiment Analysis Interspeech 2021 Leveraging the Inductive Bias of Large Language Models for Abstract Textual Reasoning NeurIPS 2021 Limitations of Autoregressive Models and Their Alternatives NAACL 2021 Linear Transformers Are Secretly Fast Weight Programmers ICML 2021 Lone Pine at SemEval-2021 Task 5: Fine-Grained Detection of Hate Speech Using BERToxic SemEval 2021 LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding AAAI 2021 LRG at SemEval-2021 Task 4: Improving Reading Comprehension with Abstract Words using Augmentation, Linguistic Features and Voting SemEval 2021 Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation ACL 2021 M-Arg: Multimodal Argument Mining Dataset for Political Debates with Audio and Transcripts EMNLP 2021 Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little EMNLP 2021 MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation ACL 2021 Measuring and Improving BERT’s Mathematical Abilities by Predicting the Order of Reasoning. ACL 2021 Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarization NAACL 2021 MeLT: Message-Level Transformer with Masked Document Representations as Pre-Training for Stance Detection EMNLP 2021 Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories EMNLP 2021 MG-BERT: Multi-Graph Augmented BERT for Masked Language Modeling NAACL 2021 Miðeind’s WMT 2021 Submission EMNLP 2021 MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection SemEval 2021 MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models CoNLL 2021 Mitigating Language-Dependent Ethnic Bias in BERT EMNLP 2021 Model Extraction and Adversarial Transferability, Your BERT is Vulnerable! NAACL 2021 mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs EMNLP 2021 Multi-accent Speech Separation with One Shot Learning ACL 2021 Multi-Layer Random Perturbation Training for improving Model Generalization Efficiently EMNLP 2021 Multilingual BERT Post-Pretraining Alignment NAACL 2021