Transformers

Bag of Tricks for Optimizing Transformer Efficiency EMNLP 2021 BANG: Bridging Autoregressive and Non-autoregressive Generation with Large Scale Pretraining ICML 2021 BART Based Semantic Correction for Mandarin Automatic Speech Recognition System Interspeech 2021 BART for Post-Correction of OCR Newspaper Text EMNLP 2021 BARTScore: Evaluating Generated Text as Text Generation NeurIPS 2021 BART-TL: Weakly-Supervised Topic Label Generation EACL 2021 BASE Layers: Simplifying Training of Large, Sparse Models ICML 2021 Batavia asked for advice. Pretrained language models for Named Entity Recognition in historical texts. EMNLP 2021 BERT4GCN: Using BERT Intermediate Layers to Augment GCN for Aspect-based Sentiment Classification EMNLP 2021 BERTAC: Enhancing Transformer-based Language Models with Adversarially Pretrained Convolutional Neural Networks ACL 2021 BERT-based Multi-Task Model for Country and Province Level MSA and Dialectal Arabic Identification EACL 2021 BERT-Based Semantic Model for Rescoring N-Best Speech Recognition List Interspeech 2021 BERT based Transformers lead the way in Extraction of Health Information from Social Media NAACL 2021 BERT Cannot Align Characters EMNLP 2021 BERT Goes Brrr: A Venture Towards the Lesser Error in Classifying Medical Self-Reporters on Twitter NAACL 2021 BERT Goes Shopping: Comparing Distributional Models for Product Representations ACL 2021 BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation EMNLP 2021 BERT meets Shapley: Extending SHAP Explanations to Transformer-based Classifiers EACL 2021 BERT Prescriptions to Avoid Unwanted Headaches: A Comparison of Transformer Architectures for Adverse Drug Event Detection EACL 2021 Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021 Beyond English-Centric Multilingual Machine Translation JMLR 2021 Beyond Grammatical Error Correction: Improving L1-influenced research writing in English using pre-trained encoder-decoder models EMNLP 2021 Beyond Paragraphs: NLP for Long Sequences NAACL 2021 Bi-Directional Joint Neural Networks for Intent Classification and Slot Filling Interspeech 2021 Bidirectional Variational Inference for Non-Autoregressive Text-to-Speech ICLR 2021