← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

MIRAGES at BioLaySumm2025: The Impact of Search Terms and Data Curation for Biomedical Lay Summarization ACL 2025
From Human Reading to NLM Understanding: Evaluating the Role of Eye-Tracking Data in Encoder-Based Models ACL 2025
LoKi: Low-dimensional KAN for Efficient Fine-tuning Image Models CVPR 2025
VL2Lite: Task-Specific Knowledge Distillation from Large Vision-Language Models to Lightweight Networks CVPR 2025
SYSTRAN @ IWSLT 2025 Low-resource track ACL 2025
AutoMixer: Checkpoint Artifacts as Automatic Data Mixers ACL 2025
NAIST Offline Speech Translation System for IWSLT 2025 ACL 2025
AI Tools Can Generate Misculture Visuals! Detecting Prompts Generating Misculture Visuals For Prevention ACL 2025
Single layer tiny Co4 outpaces GPT-2 and GPT-BERT EMNLP 2025
LETS-C: Leveraging Text Embedding for Time Series Classification ACL 2025
MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining CVPR 2025
FIRE: Flexible Integration of Data Quality Ratings for Effective Pretraining EMNLP 2025
BIRD: Bronze Inscription Restoration and Dating EMNLP 2025
Scalable Vision Language Model Training via High Quality Data Curation ACL 2025
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning CVPR 2025
DoraCycle: Domain-Oriented Adaptation of Unified Generative Model in Multimodal Cycles CVPR 2025
DA-VPT: Semantic-Guided Visual Prompt Tuning for Vision Transformers CVPR 2025
Decoder-Only LLMs can be Masked Auto-Encoders ACL 2025
Argus: A Compact and Versatile Foundation Model for Vision CVPR 2025
SAIST: Segment Any Infrared Small Target Model Guided by Contrastive Language-Image Pretraining CVPR 2025
Show and Segment: Universal Medical Image Segmentation via In-Context Learning CVPR 2025
Drop Dropout on Single Epoch Language Model Pretraining ACL 2025
HuMoCon: Concept Discovery for Human Motion Understanding CVPR 2025
Adapting Pre-trained 3D Models for Point Cloud Video Understanding via Cross-frame Spatio-temporal Perception CVPR 2025
Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases ACL 2025