Large Language Models

Translational NLP: A New Paradigm and General Principles for Natural Language Processing Research NAACL 2021 TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generation EMNLP 2021 UDALM: Unsupervised Domain Adaptation through Language Modeling NAACL 2021 ÚFAL at MultiLexNorm 2021: Improving Multilingual Lexical Normalization by Fine-tuning ByT5 EMNLP 2021 Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model ACL 2021 UNBERT: User-News Matching BERT for News Recommendation IJCAI 2021 UNBNLP at SemEval-2021 Task 1: Predicting lexical complexity with masked language models and character-level encoders SemEval 2021 Uncovering Constraint-Based Behavior in Neural Models via Targeted Fine-Tuning ACL 2021 Unified Pre-training for Program Understanding and Generation NAACL 2021 Universal Sentence Representation Learning with Conditional Masked Language Model EMNLP 2021 Unsupervised Contextualized Document Representation EMNLP 2021 Unsupervised Natural Language Parsing (Introductory Tutorial) EACL 2021 UoR at SemEval-2021 Task 4: Using Pre-trained BERT Token Embeddings for Question Answering of Abstract Meaning SemEval 2021 Verb Knowledge Injection for Multilingual Event Processing ACL 2021 ViTA: Visual-Linguistic Translation by Aligning Object Tags ACL 2021 What BERT Based Language Model Learns in Spoken Transcripts: An Empirical Study EMNLP 2021 What BERTs and GPTs know about your brand? Probing contextual language models for affect associations NAACL 2021 What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers EMNLP 2021 What Context Features Can Transformer Language Models Use? ACL 2021 What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks? ACL 2021 What’s in Your Head? Emergent Behaviour in Multi-Task Transformer Models EMNLP 2021 What to Pre-Train on? Efficient Intermediate Task Selection EMNLP 2021 When does Further Pre-training MLM Help? An Empirical Study on Task-Oriented Dialog Pre-training EMNLP 2021 When does text prediction benefit from additional context? An exploration of contextual signals for chat and email messages NAACL 2021 When Do You Need Billions of Words of Pretraining Data? ACL 2021