← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

ViLMedic: a framework for research at the intersection of vision and language in medical AI ACL 2022
Vision-Language Pretraining: Current Trends and the Future ACL 2022
Improving Relation Extraction through Syntax-induced Pre-training with Dependency Masking ACL 2022
EnCBP: A New Benchmark Dataset for Finer-Grained Cultural Background Prediction in English ACL 2022
GenCompareSum: a hybrid unsupervised summarization method using salience ACL 2022
ANNA: Enhanced Language Representation for Question Answering ACL 2022
ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classification ACL 2022
Label Semantic Aware Pre-training for Few-shot Text Classification ACL 2022
PPT: Pre-trained Prompt Tuning for Few-shot Learning ACL 2022
Inverse is Better! Fast and Accurate Prompt for Few-shot Slot Tagging ACL 2022
Striking a Balance: Alleviating Inconsistency in Pre-trained Models for Symmetric Classification Tasks ACL 2022
Knowledge-Augmented Language Models for Cause-Effect Relation Classification ACL 2022
UNIMO-2: End-to-End Unified Vision-Language Grounded Learning ACL 2022
Less Descriptive yet Discriminative: Quantifying the Properties of Multimodal Referring Utterances via CLIP ACL 2022
Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation? ACL 2022
MarkupLM: Pre-training of Text and Markup Language for Visually Rich Document Understanding ACL 2022
OpenPrompt: An Open-source Framework for Prompt-learning ACL 2022
Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models ACL 2022
Modular and Parameter-Efficient Multimodal Fusion with Prompting ACL 2022
PRINCE: Prefix-Masked Decoding for Knowledge Enhanced Sequence-to-Sequence Pre-Training EMNLP 2022
ROSE: Robust Selective Fine-tuning for Pre-trained Language Models EMNLP 2022
ConvTrans: Transforming Web Search Sessions for Conversational Dense Retrieval EMNLP 2022
Natural Language to Code Translation with Execution EMNLP 2022
MGDoc: Pre-training with Multi-granular Hierarchy for Document Image Understanding EMNLP 2022
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks EMNLP 2022