Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Zambezi Voice: A Multilingual Speech Corpus for Zambian Languages INTERSPEECH 2023

How to Construct Perfect and Worse-than-Coin-Flip Spoofing Countermeasures: A Word of Warning on Shortcut Learning INTERSPEECH 2023

Description and Analysis of ABC Submission to NIST LRE 2022 INTERSPEECH 2023

BIOptimus: Pre-training an Optimal Biomedical Language Model with Curriculum Learning for Named Entity Recognition ACL 2023

AliBERT: A Pre-trained Language Model for French Biomedical Text ACL 2023

Diffused Redundancy in Pre-trained Representations NIPS 2023

Efficient Equivariant Transfer Learning from Pretrained Models NIPS 2023

Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Text NIPS 2023

EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation Learning NIPS 2023

Robust Contrastive Language-Image Pretraining against Data Poisoning and Backdoor Attacks NIPS 2023

Efficient Low-rank Backpropagation for Vision Transformer Adaptation NIPS 2023

Flaky Performances When Pretraining on Relational Databases (Student Abstract) AAAI 2023

FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer AAAI 2023

Prefix Conditioning Unifies Language and Label Supervision CVPR 2023

A Comprehensive Study on Text-attributed Graphs: Benchmarking and Rethinking NIPS 2023

BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editing NIPS 2023

Train Once and Explain Everywhere: Pre-training Interpretable Graph Neural Networks NIPS 2023

GlyphControl: Glyph Conditional Control for Visual Text Generation NIPS 2023

Equivariant Adaptation of Large Pretrained Models NIPS 2023

GEO-Bench: Toward Foundation Models for Earth Monitoring NIPS 2023

Feature Normalization and Cartography-Based Demonstrations for Prompt-Based Fine-Tuning on Emotion-Related Tasks AAAI 2023

Unifying Vision-Language Representation Space with Single-Tower Transformer AAAI 2023

Attentive Mask CLIP ICCV 2023

GPT-ST: Generative Pre-Training of Spatio-Temporal Graph Neural Networks NIPS 2023

Learning Visual Prior via Generative Pre-Training NIPS 2023