Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Patton: Language Model Pretraining on Text-Rich Networks ACL 2023

Tell2Design: A Dataset for Language-Guided Floor Plan Generation ACL 2023

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning ACL 2023

Exploring Lottery Prompts for Pre-trained Language Models ACL 2023

NOTABLE: Transferable Backdoor Attacks Against Prompt-based NLP Models ACL 2023

AraMUS: Pushing the Limits of Data and Model Scale for Arabic Natural Language Processing ACL 2023

Automatic Table Union Search with Tabular Representation Learning ACL 2023

Fusion or Defusion? Flexible Vision-and-Language Pre-Training ACL 2023

GersteinLab at MEDIQA-Chat 2023: Clinical Note Summarization from Doctor-Patient Conversations through Fine-tuning and In-context Learning ACL 2023

BERTastic at SemEval-2023 Task 3: Fine-Tuning Pretrained Multilingual Transformers Does Order Matter? ACL 2023

Team QUST at SemEval-2023 Task 3: A Comprehensive Study of Monolingual and Multilingual Approaches for Detecting Online News Genre, Framing and Persuasion Techniques ACL 2023

FMI-SU at SemEval-2023 Task 7: Two-level Entailment Classification of Clinical Trials Enhanced by Contextual Data Augmentation ACL 2023

Self-Evolution Learning for Discriminative Language Model Pretraining ACL 2023

Spatio-Temporal Crop Aggregation for Video Representation Learning ICCV 2023

Improving Training and Inference of Face Recognition Models via Random Temperature Scaling AAAI 2023

SheetPT: Spreadsheet Pre-training Based on Hierarchical Attention Network AAAI 2023

Delving Into Masked Autoencoders for Multi-Label Thorax Disease Classification WACV 2023

PreViTS: Contrastive Pretraining With Video Tracking Supervision WACV 2023

UVCGAN: UNet Vision Transformer Cycle-Consistent GAN for Unpaired Image-to-Image Translation WACV 2023

Self-Supervised Pyramid Representation Learning for Multi-Label Visual Analysis and Beyond WACV 2023

EventPoint: Self-Supervised Interest Point Detection and Description for Event-Based Camera WACV 2023

Synthesize, Prompt and Transfer: Zero-shot Conversational Question Generation with Pre-trained Language Model ACL 2023

BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associations EMNLP 2023

CAPSTONE: Curriculum Sampling for Dense Retrieval with Document Expansion EMNLP 2023

Zelda Rose: a tool for hassle-free training of transformer models EMNLP 2023