← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

LP++: A Surprisingly Strong Linear Probe for Few-Shot CLIP CVPR 2024
CrossMAE: Cross-Modality Masked Autoencoders for Region-Aware Audio-Visual Pre-Training CVPR 2024
Time- Memory- and Parameter-Efficient Visual Adaptation CVPR 2024
Instruction Pre-Training: Language Models are Supervised Multitask Learners EMNLP 2024
Cross-transfer Knowledge between Speech and Text Encoders to Evaluate Customer Satisfaction INTERSPEECH 2024
DecorateLM: Data Engineering through Corpus Rating, Tagging, and Editing with Language Models EMNLP 2024
Transferable Adversarial Attacks on SAM and Its Downstream Models NIPS 2024
CapHuman: Capture Your Moments in Parallel Universes CVPR 2024
Multimodal Prompt Perceiver: Empower Adaptiveness Generalizability and Fidelity for All-in-One Image Restoration CVPR 2024
Enhancing Multi-Scale Diffusion Prediction via Sequential Hypergraphs and Adversarial Learning AAAI 2024
On the Generalization Ability of Unsupervised Pretraining AISTATS 2024
From Bottom to Top: Extending the Potential of Parameter Efficient Fine-Tuning EMNLP 2024
ShefCDTeam at SemEval-2024 Task 4: A Text-to-Text Model for Multi-Label Classification SEMEVAL 2024
Textual-Driven Adversarial Purification for Speaker Verification INTERSPEECH 2024
Enhancing Multimodal Knowledge Graph Representation Learning through Triple Contrastive Learning IJCAI 2024
UDON: Universal Dynamic Online distillatioN for generic image representations NIPS 2024
SNN-PDE: Learning Dynamic PDEs from Data with Simplicial Neural Networks AAAI 2024
DTL: Disentangled Transfer Learning for Visual Recognition AAAI 2024
Cluster-Learngene: Inheriting Adaptive Clusters for Vision Transformers NIPS 2024
SA-WavLM: Speaker-Aware Self-Supervised Pre-training for Mixture Speech INTERSPEECH 2024
UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling NIPS 2024
BioCLIP: A Vision Foundation Model for the Tree of Life CVPR 2024
S2MAE: A Spatial-Spectral Pretraining Foundation Model for Spectral Remote Sensing Data CVPR 2024
Pre-training Vision Models with Mandelbulb Variations CVPR 2024
Self-StrAE at SemEval-2024 Task 1: Making Self-Structuring AutoEncoders Learn More With Less NAACL 2024