← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Image Captioners Are Scalable Vision Learners Too NIPS 2023
Cross-modal Prompts: Adapting Large Pre-trained Models for Audio-Visual Downstream Tasks NIPS 2023
VidChapters-7M: Video Chapters at Scale NIPS 2023
HOMO-MEX: A Mexican Spanish Annotated Corpus for LGBT+phobia Detection on Twitter ACL 2023
ProteinShake: Building datasets and benchmarks for deep learning on protein structures NIPS 2023
Positional Label for Self-Supervised Vision Transformer AAAI 2023
BEST: BERT Pre-training for Sign Language Recognition with Coupling Tokenization AAAI 2023
SSL4EO-L: Datasets and Foundation Models for Landsat Imagery NIPS 2023
On the Connection between Pre-training Data Diversity and Fine-tuning Robustness NIPS 2023
Controlling Text-to-Image Diffusion by Orthogonal Finetuning NIPS 2023
A Retrospect to Multi-prompt Learning across Vision and Language ICCV 2023
The Risk and Opportunity of Data Augmentation and Translation for ESG News Impact Identification with Language Models IJCNLP 2023
Enhanced Chart Understanding via Visual Language Pre-training on Plot Table Pairs ACL 2023
Towards a Holistic Understanding of Mathematical Questions with Contrastive Pre-training AAAI 2023
Towards Understanding Omission in Dialogue Summarization ACL 2023
TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities ACL 2023
KPT: Keyword-Guided Pre-training for Grounded Dialog Generation AAAI 2023
CSECU-DSG at SemEval-2023 Task 6: Segmenting Legal Documents into Rhetorical Roles via Fine-tuned Transformer Architecture ACL 2023
Pivotal Role of Language Modeling in Recommender Systems: Enriching Task-specific and Task-agnostic Representation Learning ACL 2023
From Characters to Words: Hierarchical Pre-trained Language Model for Open-vocabulary Language Understanding ACL 2023
Infusing Hierarchical Guidance into Prompt Tuning: A Parameter-Efficient Framework for Multi-level Implicit Discourse Relation Recognition ACL 2023
ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Texts ICML 2023
Cross-Modal Fine-Tuning: Align then Refine ICML 2023
Internet Explorer: Targeted Representation Learning on the Open Web ICML 2023
NeuralStagger: Accelerating Physics-constrained Neural PDE Solver with Spatial-temporal Decomposition ICML 2023