← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Towards Anytime Fine-tuning: Continually Pre-trained Language Models with Hypernetwork Prompts EMNLP 2023
Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation EMNLP 2023
On Enhancing Fine-Tuning for Pre-trained Language Models EMNLP 2023
rematchka at ArAIEval Shared Task: Prefix-Tuning & Prompt-tuning for Improved Detection of Propaganda and Disinformation in Arabic Social Media Content EMNLP 2023
Nexus at ArAIEval Shared Task: Fine-Tuning Arabic Language Models for Propaganda and Disinformation Detection EMNLP 2023
RSM-NLP at BLP-2023 Task 2: Bangla Sentiment Analysis using Weighted and Majority Voted Fine-Tuned Transformers EMNLP 2023
Analyzing Pre-trained and Fine-tuned Language Models EMNLP 2023
SurreyAI 2023 Submission for the Quality Estimation Shared Task EMNLP 2023
PRHLT’s Submission to WLAC 2023 EMNLP 2023
TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance ICCV 2023
HiVLP: Hierarchical Interactive Video-Language Pre-Training ICCV 2023
Sign Language Translation with Iterative Prototype ICCV 2023
Diffusion Models as Masked Autoencoders ICCV 2023
Logit-based ensemble distribution distillation for robust autoregressive sequence uncertainties UAI 2023
Exploring the Benefits of Visual Prompting in Differential Privacy ICCV 2023
Tuning Pre-trained Model via Moment Probing ICCV 2023
PEER: Pre-training ELECTRA Extended by Ranking ACL 2023
MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training for X-ray Diagnosis ICCV 2023
On Efficient Transformer-Based Image Pre-training for Low-Level Vision IJCAI 2023
Improving Sign Recognition with Phonology EACL 2023
A Unified View of Deep Learning for Reaction and Retrosynthesis Prediction: Current Status and Future Challenges IJCAI 2023
Better Pre-Training by Reducing Representation Confusion EACL 2023
Modelling Temporal Document Sequences for Clinical ICD Coding EACL 2023
FrameBERT: Conceptual Metaphor Detection with Frame Embedding Learning EACL 2023
Do we need Label Regularization to Fine-tune Pre-trained Language Models? EACL 2023