← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

RuCoLA: Russian Corpus of Linguistic Acceptability EMNLP 2022
RACE: Retrieval-augmented Commit Message Generation EMNLP 2022
ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts EMNLP 2022
Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples EMNLP 2022
Parameter-Efficient Tuning Makes a Good Classification Head EMNLP 2022
Differentiable Data Augmentation for Contrastive Sentence Representation Learning EMNLP 2022
COLD: A Benchmark for Chinese Offensive Language Detection EMNLP 2022
Fine-mixing: Mitigating Backdoors in Fine-tuned Language Models EMNLP 2022
XDoc: Unified Pre-training for Cross-Format Document Understanding EMNLP 2022
Generative Prompt Tuning for Relation Classification EMNLP 2022
Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA EMNLP 2022
ZeroPrompt: Scaling Prompt-Based Pretraining to 1,000 Tasks Improves Zero-Shot Generalization EMNLP 2022
Task Compass: Scaling Multi-task Pre-training with Task Prefix EMNLP 2022
Transformers on Multilingual Clause-Level Morphology EMNLP 2022
Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Features EMNLP 2022
Reasoning Like Program Executors EMNLP 2022
Entity Extraction in Low Resource Domains with Selective Pre-training of Large Language Models EMNLP 2022
CodeRetriever: A Large Scale Contrastive Pre-Training Method for Code Search EMNLP 2022
Controlled Language Generation for Language Learning Items EMNLP 2022
LEMON: Language-Based Environment Manipulation via Execution-Guided Pre-training EMNLP 2022
Late Prompt Tuning: A Late Prompt Could Be Better Than Many Prompts EMNLP 2022
Masked Autoencoders Are Scalable Vision Learners CVPR 2022
CrossLoc: Scalable Aerial Localization Assisted by Multimodal Synthetic Data CVPR 2022
BEVT: BERT Pretraining of Video Transformers CVPR 2022
Patch-Level Representation Learning for Self-Supervised Vision Transformers CVPR 2022