Large Language Models

Contrastive Out-of-Distribution Detection for Pretrained Transformers EMNLP 2021 DEBERTA: DECODING-ENHANCED BERT WITH DISENTANGLED ATTENTION ICLR 2021 Degree Planning with PLAN-BERT: Multi-Semester Recommendation Using Future Courses of Interest AAAI 2021 Does She Wink or Does She Nod? A Challenging Benchmark for Evaluating Word Understanding of Language Models EACL 2021 Examining the Inductive Bias of Neural Language Models with Artificial Languages ACL 2021 Explaining Relationships Between Scientific Documents ACL 2021 Frequency Effects on Syntactic Rule Learning in Transformers EMNLP 2021 GiBERT: Enhancing BERT with Linguistic Information using a Lightweight Gated Injection Method EMNLP 2021 Hi-Transformer: Hierarchical Interactive Transformer for Efficient and Effective Long Document Modeling ACL 2021 How Does BERT Rerank Passages? An Attribution Analysis with Information Bottlenecks EMNLP 2021 How much coffee was consumed during EMNLP 2019? Fermi Problems: A New Reasoning Challenge for AI EMNLP 2021 How to Adapt Your Pretrained Multilingual Model to 1600 Languages ACL 2021 Hyperparameter Power Impact in Transformer Language Model Training EMNLP 2021 Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases ACL 2021 K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce EMNLP 2021 Large-Scale Relation Learning for Question Answering over Knowledge Bases with Pre-trained Language Models EMNLP 2021 Learning about Word Vector Representations and Deep Learning through Implementing Word2vec NAACL 2021 Leveraging Table Content for Zero-shot Text-to-SQL with Meta-Learning AAAI 2021 Leveraging the Inductive Bias of Large Language Models for Abstract Textual Reasoning NeurIPS 2021 LMdiff: A Visual Diff Tool to Compare Language Models EMNLP 2021 LMSOC: An Approach for Socially Sensitive Pretraining EMNLP 2021 Making Pre-trained Language Models Better Few-shot Learners ACL 2021 Measuring Massive Multitask Language Understanding ICLR 2021 Modeling Hierarchical Structures with Continuous Recursive Neural Networks ICML 2021 Naive Bayes versus BERT: Jupyter notebook assignments for an introductory NLP course NAACL 2021