← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

ProQA: Structural Prompt-based Pre-training for Unified Question Answering NAACL 2022
A Data Cartography based MixUp for Pre-trained Language Models NAACL 2022
Cross-Modal Mutual Learning for Audio-Visual Speech Recognition and Manipulation AAAI 2022
Zero-Shot Cross-Lingual Machine Reading Comprehension via Inter-sentence Dependency Graph AAAI 2022
CINS: Comprehensive Instruction for Few-Shot Learning in Task-Oriented Dialog Systems AAAI 2022
Analyzing Generalization of Vision and Language Navigation to Unseen Outdoor Areas ACL 2022
SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing ACL 2022
Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering ACL 2022
Diverse Lottery Tickets Boost Ensemble from a Single Pretrained Model ACL 2022
On Masked Language Models for Contextual Link Prediction ACL 2022
Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection EMNLP 2022
Soft-Labeled Contrastive Pre-Training for Function-Level Code Representation EMNLP 2022
Utilizing Language-Image Pretraining for Efficient and Robust Bilingual Word Alignment EMNLP 2022
Effective Pretraining Objectives for Transformer-based Autoencoders EMNLP 2022
Semi-Supervised Knowledge-Grounded Pre-training for Task-Oriented Dialog Systems EMNLP 2022
Arabic Keyphrase Extraction: Enhancing Deep Learning Models with Pre-trained Contextual Embedding and External Features EMNLP 2022
Translation between Molecules and Natural Language EMNLP 2022
TRIPS: Efficient Vision-and-Language Pre-training with Text-Relevant Image Patch Selection EMNLP 2022
Spectral Probing EMNLP 2022
MCP: Self-supervised Pre-training for Personalized Chatbots with Multi-level Contrastive Sampling EMNLP 2022
ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding EMNLP 2022
One size does not fit all: Investigating strategies for differentially-private learning across NLP tasks EMNLP 2022
Biomedical NER for the Enterprise with Distillated BERN2 and the Kazu Framework EMNLP 2022
Self-Supervised Models Are Continual Learners CVPR 2022
BatchFormer: Learning To Explore Sample Relationships for Robust Representation Learning CVPR 2022