Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

DegAE: A New Pretraining Paradigm for Low-Level Vision CVPR 2023

UniFormerV2: Unlocking the Potential of Image ViTs for Video Understanding ICCV 2023

DR-Tune: Improving Fine-tuning of Pretrained Visual Models by Distribution Regularization with Semantic Calibration ICCV 2023

Masked Path Modeling for Vision-and-Language Navigation EMNLP 2023

DocSplit: Simple Contrastive Pretraining for Large Document Embeddings EMNLP 2023

Vector-Quantized Prompt Learning for Paraphrase Generation EMNLP 2023

Decomposed Prompt Tuning via Low-Rank Reparameterization EMNLP 2023

Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text Retrievers EMNLP 2023

Enhancing Emotion Recognition in Conversation via Multi-view Feature Alignment and Memorization EMNLP 2023

CONTRASTE: Supervised Contrastive Pre-training With Aspect-based Prompts For Aspect Sentiment Triplet Extraction EMNLP 2023

ConPrompt: Pre-training a Language Model with Machine-Generated Data for Implicit Hate Speech Detection EMNLP 2023

Contrastive Learning-based Sentence Encoders Implicitly Weight Informative Words EMNLP 2023

SELFOOD: Self-Supervised Out-Of-Distribution Detection via Learning to Rank EMNLP 2023

MEGClass: Extremely Weakly Supervised Text Classification via Mutually-Enhancing Text Granularities EMNLP 2023

RSVP: Customer Intent Detection via Agent Response Contrastive and Generative Pre-Training EMNLP 2023

TSTR: Target Similarity Tuning Meets the Real World EMNLP 2023

Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules EMNLP 2023

Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models EMNLP 2023

Unleashing the Power of Language Models in Text-Attributed Graph EMNLP 2023

Automatic Pronunciation Assessment - A Review EMNLP 2023

Few-shot Unified Question Answering: Tuning Models or Prompts? EMNLP 2023

Frequency Balanced Datasets Lead to Better Language Models EMNLP 2023

TRIP: Accelerating Document-level Multilingual Pre-training via Triangular Document-level Pre-training on Parallel Data Triplets EMNLP 2023

Flatness-Aware Prompt Selection Improves Accuracy and Sample Efficiency EMNLP 2023

Parameter-Efficient Cross-lingual Transfer of Vision and Language Models via Translation-based Alignment EMNLP 2023