Pretraining

LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval NAACL 2021 LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning ICML 2021 Lips Don't Lie: A Generalisable and Robust Approach To Face Forgery Detection CVPR 2021 LiRA: Learning Visual Speech Representations from Audio Through Self-Supervision Interspeech 2021 LocTex: Learning Data-Efficient Visual Representations From Localized Textual Supervision ICCV 2021 Long Document Summarization in a Low Resource Setting using Pretrained Language Models ACL 2021 Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence ACL 2021 Low-Resource Dialogue Summarization with Domain-Agnostic Multi-Source Pretraining EMNLP 2021 Making Pre-trained Language Models Better Few-shot Learners ACL 2021 MaxUp: Lightweight Adversarial Training With Data Augmentation Improves Neural Network Training CVPR 2021 MeshTalk: 3D Face Animation From Speech Using Cross-Modality Disentanglement ICCV 2021 Meta-learning to Improve Pre-training NeurIPS 2021 MoRe: A Large-Scale Motorcycle Re-Identification Dataset WACV 2021 mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer NAACL 2021 mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs EMNLP 2021 Multidomain Pretrained Language Models for Green NLP EACL 2021 Multi-Level Curriculum for Training a Distortion-Aware Barrel Distortion Rectification Model ICCV 2021 Multilingual Machine Translation Evaluation Metrics Fine-tuned on Pseudo-Negative Examples for WMT 2021 Metrics Task EMNLP 2021 Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task EMNLP 2021 Multilingual Speech Translation KIT @ IWSLT2021 ACL 2021 NeurST: Neural Speech Translation Toolkit ACL 2021 NICT Kyoto Submission for the WMT’21 Quality Estimation Task: Multimetric Multilingual Pretraining for Critical Error Detection EMNLP 2021 N-ImageNet: Towards Robust, Fine-Grained Object Recognition With Event Cameras ICCV 2021 N-MTTL SI Model: Non-Intrusive Multi-Task Transfer Learning-Based Speech Intelligibility Prediction Model with Scenery Classification Interspeech 2021 Novel Natural Language Summarization of Program Code via Leveraging Multiple Input Representations EMNLP 2021