Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

ROCES: Robust Class Expression Synthesis in Description Logics via Iterative Sampling IJCAI 2024

A CURATEd CATalog: Rethinking the Extraction of Pretraining Corpora for Mid-Resourced Languages COLING 2024

Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning ACL 2024

Compact Speech Translation Models via Discrete Speech Units Pretraining ACL 2024

Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data ACL 2024

Knowledge Acquisition through Continued Pretraining is Difficult: A Case Study on r/AskHistorians ACL 2024

Tell Me What’s Next: Textual Foresight for Generic UI Representations ACL 2024

ReactXT: Understanding Molecular “Reaction-ship” via Reaction-Contextualized Molecule-Text Pretraining ACL 2024

Model Editing by Standard Fine-Tuning ACL 2024

CALVIN: Improved Contextual Video Captioning via Instruction Tuning NIPS 2024

Knowlab’s Submission to L+M Shared Task: All you need is continued pretraining of chemistry texts even for molecule captioning ACL 2024

A Logical Pattern Memory Pre-trained Model for Entailment Tree Generation COLING 2024

Self-StrAE at SemEval-2024 Task 1: Making Self-Structuring AutoEncoders Learn More With Less SEMEVAL 2024

KerasCV and KerasNLP: Multi-framework Models JMLR 2024

Scaling Speech Technology to 1,000+ Languages JMLR 2024

SequenceMatch: Revisiting the Design of Weak-Strong Augmentations for Semi-Supervised Learning WACV 2024

Are Natural Domain Foundation Models Useful for Medical Image Classification? WACV 2024

Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning NIPS 2024

SynergyNet: Bridging the Gap Between Discrete and Continuous Representations for Precise Medical Image Segmentation WACV 2024

NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long Documents ACL 2024

BirdSAT: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping WACV 2024

G2D: From Global to Dense Radiography Representation Learning via Vision-Language Pre-training NIPS 2024

SEMA: Semantic Attention for Capturing Long-Range Dependencies in Egocentric Lifelogs WACV 2024

InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuning CVPR 2024

Annotation-Free Audio-Visual Segmentation WACV 2024