Pretraining

DENTRA: Denoising and Translation Pre-training for Multilingual Machine Translation EMNLP 2022 DeToxy: A Large-Scale Multimodal Dataset for Toxicity Classification in Spoken Utterances Interspeech 2022 DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning IJCAI 2022 Differentiable Data Augmentation for Contrastive Sentence Representation Learning EMNLP 2022 Distributional properties of political dogwhistle representations in Swedish BERT NAACL 2022 Diverse Lottery Tickets Boost Ensemble from a Single Pretrained Model ACL 2022 Divide and Rule: Effective Pre-Training for Context-Aware Multi-Encoder Translation Models ACL 2022 DocQueryNet: Value Retrieval with Arbitrary Queries for Form-like Documents COLING 2022 Dynamic Scene Graph Generation via Anticipatory Pre-Training CVPR 2022 DynamicTOC: Persona-based Table of Contents for Consumption of Long Documents NAACL 2022 Effective Pretraining Objectives for Transformer-based Autoencoders EMNLP 2022 Efficient Multilingual Multi-modal Pre-training through Triple Contrastive Loss COLING 2022 Efficient Self-supervised Vision Transformers for Representation Learning ICLR 2022 Efficient Zero-shot Event Extraction with Context-Definition Alignment EMNLP 2022 ELLE: Efficient Lifelong Pre-training for Emerging Data ACL 2022 Elucidating the Design Space of Diffusion-Based Generative Models NeurIPS 2022 Embedded Ensembles: infinite width limit and operating regimes AISTATS 2022 EnCBP: A New Benchmark Dataset for Finer-Grained Cultural Background Prediction in English ACL 2022 End-to-End Generative Pretraining for Multimodal Video Captioning CVPR 2022 Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples EMNLP 2022 Entity Extraction in Low Resource Domains with Selective Pre-training of Large Language Models EMNLP 2022 Environment Predictive Coding for Visual Navigation ICLR 2022 ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding EMNLP 2022 Evaluating high-order predictive distributions in deep learning UAI 2022 Expanding Large Pre-Trained Unimodal Models With Multimodal Information Injection for Image-Text Multimodal Classification CVPR 2022