Large Language Models

On the Robustness of Language Encoders against Grammatical Errors ACL 2020 Predicting Reference: What do Language Models Learn about Discourse Models? EMNLP 2020 Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model ICLR 2020 Pretrained Transformers Improve Out-of-Distribution Robustness ACL 2020 Probing Pretrained Language Models for Lexical Semantics EMNLP 2020 Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT AAAI 2020 RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models EMNLP 2020 Relation-Aware Transformer for Portfolio Policy Learning IJCAI 2020 Revisiting Pre-Trained Models for Chinese Natural Language Processing EMNLP 2020 RikiNet: Reading Wikipedia Pages for Natural Question Answering ACL 2020 RobBERT: a Dutch RoBERTa-based Language Model EMNLP 2020 Robustness to Programmable String Transformations via Augmented Abstract Training ICML 2020 Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answering EMNLP 2020 Semantics-Aware BERT for Language Understanding AAAI 2020 Successes, Challenges and Opportunities for Speech Technology in Conversational Agents Interspeech 2020 The Sensitivity of Language Models and Humans to Winograd Schema Perturbations ACL 2020 This is a BERT. Now there are several of them. Can they generalize to novel words? EMNLP 2020 Towards Interpreting BERT for Reading Comprehension Based QA EMNLP 2020 Towards Neural Programming Interfaces NeurIPS 2020 Using Large Pretrained Language Models for Answering User Queries from Product Specifications ACL 2020 Visually-Grounded Planning without Vision: Language Models Infer Detailed Plans from High-level Instructions EMNLP 2020 WinoGrande: An Adversarial Winograd Schema Challenge at Scale AAAI 2020 Defending Against Neural Fake News NeurIPS 2019 ERNIE: Enhanced Language Representation with Informative Entities ACL 2019 Hello, It’s GPT-2 - How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systems EMNLP 2019