← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Bootstrapping ViTs: Towards Liberating Vision Transformers From Pre-Training CVPR 2022
GeoEngine: A Platform for Production-Ready Geospatial Research CVPR 2022
Sound and Visual Representation Learning With Multiple Pretraining Tasks CVPR 2022
ObjectFormer for Image Manipulation Detection and Localization CVPR 2022
Unsupervised Representation Learning for Binary Networks by Joint Classifier Learning CVPR 2022
UniVIP: A Unified Framework for Self-Supervised Visual Pre-Training CVPR 2022
Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis CVPR 2022
Scenic: A JAX Library for Computer Vision Research and Beyond CVPR 2022
Expanding Large Pre-Trained Unimodal Models With Multimodal Information Injection for Image-Text Multimodal Classification CVPR 2022
Swin Transformer V2: Scaling Up Capacity and Resolution CVPR 2022
Conditional Prompt Learning for Vision-Language Models CVPR 2022
Vision-Language Pre-Training With Triple Contrastive Learning CVPR 2022
Seeing the forest and the tree: Building representations of both individual and collective dynamics with transformers NIPS 2022
S-Prompts Learning with Pre-trained Transformers: An Occam’s Razor for Domain Incremental Learning NIPS 2022
Deep Compression of Pre-trained Transformer Models NIPS 2022
Addressing Resource Scarcity across Sign Languages with Multilingual Pretraining and Unified-Vocabulary Datasets NIPS 2022
GlossReader at LSCDiscovery: Train to Select a Proper Gloss in English – Discover Lexical Semantic Change in Spanish ACL 2022
Improving Social Meaning Detection with Pragmatic Masking and Surrogate Fine-Tuning ACL 2022
Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manuals ACL 2022
Vision-Language Pre-Training for Multimodal Aspect-Based Sentiment Analysis ACL 2022
RST Discourse Parsing with Second-Stage EDU-Level Pre-training ACL 2022
Divide and Rule: Effective Pre-Training for Context-Aware Multi-Encoder Translation Models ACL 2022
PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization ACL 2022
Data Contamination: From Memorization to Exploitation ACL 2022
ELLE: Efficient Lifelong Pre-training for Emerging Data ACL 2022