← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Learning to Deblur Using Light Field Generated and Real Defocus Images CVPR 2022
Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning OSDI 2022
Embedded Ensembles: infinite width limit and operating regimes AISTATS 2022
Visual Emotion Representation Learning via Emotion-Aware Pre-training IJCAI 2022
Fine-Tuning Graph Neural Networks via Graph Topology Induced Optimal Transport IJCAI 2022
Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation? IJCAI 2022
SCHA-VAE: Hierarchical Context Aggregation for Few-Shot Generation ICML 2022
You Only Cut Once: Boosting Data Augmentation with a Single Cut ICML 2022
Robust Fine-Tuning of Deep Neural Networks with Hessian-based Generalization Guarantees ICML 2022
DAVINZ: Data Valuation using Deep Neural Networks at Initialization ICML 2022
AugCSE: Contrastive Sentence Embedding with Diverse Augmentations IJCNLP 2022
Fine-grained Contrastive Learning for Definition Generation IJCNLP 2022
CLIP4IDC: CLIP for Image Difference Captioning IJCNLP 2022
Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks IJCNLP 2022
F-coref: Fast, Accurate and Easy to Use Coreference Resolution IJCNLP 2022
Recent Advances in Pre-trained Language Models: Why Do They Work and How Do They Work IJCNLP 2022
When Cantonese NLP Meets Pre-training: Progress and Challenges IJCNLP 2022
GRASP: Guiding Model with RelAtional Semantics Using Prompt for Dialogue Relation Extraction COLING 2022
SelfMix: Robust Learning against Textual Label Noise with Self-Mixup Training COLING 2022
Addressing Leakage in Self-Supervised Contextualized Code Retrieval COLING 2022
MonoByte: A Pool of Monolingual Byte-level Language Models COLING 2022
Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuning COLING 2022
TSTR: Too Short to Represent, Summarize with Details! Intro-Guided Extended Summary Generation NAACL 2022
FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization NAACL 2022
Yes, No or IDK: The Challenge of Unanswerable Yes/No Questions NAACL 2022