← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

The student becomes the master: Outperforming GPT3 on Scientific Factual Error Correction EMNLP 2023
Distilling ChatGPT for Explainable Automated Student Answer Assessment EMNLP 2023
Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting EMNLP 2023
Adapting Pretrained Text-to-Text Models for Long Text Sequences EMNLP 2023
Black-Box Tuning of Vision-Language Models with Effective Gradient Approximation EMNLP 2023
Exploring Graph Pre-training for Aspect-based Sentiment Analysis EMNLP 2023
GRENADE: Graph-Centric Language Model for Self-Supervised Representation Learning on Text-Attributed Graphs EMNLP 2023
AdaTranS: Adapting with Boundary-based Shrinking for End-to-End Speech Translation EMNLP 2023
Byte Pair Encoding for Symbolic Music EMNLP 2023
Model-tuning Via Prompts Makes NLP Models Adversarially Robust EMNLP 2023
Generative Table Pre-training Empowers Models for Tabular Prediction EMNLP 2023
Automatic Transcription of Handwritten Old Occitan Language EMNLP 2023
Learning Knowledge-Enhanced Contextual Language Representations for Domain Natural Language Understanding EMNLP 2023
Do Transformers Parse while Predicting the Masked Word? EMNLP 2023
JASMINE: Arabic GPT Models for Few-Shot Learning EMNLP 2023
Evaluating Self-Supervised Learning via Risk Decomposition ICML 2023
AudioLDM: Text-to-Audio Generation with Latent Diffusion Models ICML 2023
Reprogramming Pretrained Language Models for Antibody Sequence Infilling ICML 2023
Improving Visual Prompt Tuning for Self-supervised Vision Transformers ICML 2023
XTab: Cross-table Pretraining for Tabular Transformers ICML 2023
Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles ICML 2023
BEATs: Audio Pre-Training with Acoustic Tokenizers ICML 2023
YATO: Yet Another deep learning based Text analysis Open toolkit EMNLP 2023
KD-Boost: Boosting Real-Time Semantic Matching in E-commerce with Knowledge Distillation EMNLP 2023
Pretraining Without Attention EMNLP 2023