Large Language Models

A Thorough Evaluation of Task-Specific Pretraining for Summarization EMNLP 2021 AttesTable at SemEval-2021 Task 9: Extending Statement Verification with Tables for Unknown Class, and Semantic Evidence Finding SemEval 2021 Attribute Alignment: Controlling Text Generation from Pre-trained Language Models EMNLP 2021 AutoText: An End-to-End AutoAI Framework for Text AAAI 2021 AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models ACL 2021 BARThez: a Skilled Pretrained French Sequence-to-Sequence Model EMNLP 2021 Bayesian Model-Agnostic Meta-Learning with Matrix-Valued Kernels for Quality Estimation ACL 2021 BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief EMNLP 2021 Benchmarking Pre-trained Language Models for Multilingual NER: TraSpaS at the BSNLP2021 Shared Task EACL 2021 BERTAC: Enhancing Transformer-based Language Models with Adversarially Pretrained Convolutional Neural Networks ACL 2021 BERT-Based Semantic Model for Rescoring N-Best Speech Recognition List Interspeech 2021 BERT based Transformers lead the way in Extraction of Health Information from Social Media NAACL 2021 BERT Cannot Align Characters EMNLP 2021 BERTGen: Multi-task Generation through BERT ACL 2021 BERT Has Uncommon Sense: Similarity Ranking for Word Sense BERTology EMNLP 2021 BERTić - The Transformer Language Model for Bosnian, Croatian, Montenegrin and Serbian EACL 2021 BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies? ACL 2021 BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation EMNLP 2021 BERTweetFR : Domain Adaptation of Pre-Trained Language Models for French Tweets EMNLP 2021 Beyond Sentence-Level End-to-End Speech Translation: Context Helps ACL 2021 Bilingual Alignment Pre-Training for Zero-Shot Cross-Lingual Transfer EMNLP 2021 BioELECTRA:Pretrained Biomedical text Encoder using Discriminators NAACL 2021 BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Data ACL 2021 Breaking Writer’s Block: Low-cost Fine-tuning of Natural Language Generation Models EACL 2021 Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation ACL 2021