← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

UniMuMo: Unified Text, Music, and Motion Generation AAAI 2025
Efficient Adaptation of Pre-trained Vision Transformer underpinned by Approximately Orthogonal Fine-Tuning Strategy ICCV 2025
Less-to-More Generalization: Unlocking More Controllability by In-Context Generation ICCV 2025
MANTA: A Scalable Pipeline for Transmuting Massive Web Corpora into Instruction Datasets EMNLP 2025
ReTracker: Exploring Image Matching for Robust Online Any Point Tracking ICCV 2025
CustomTTT: Motion and Appearance Customized Video Generation via Test-Time Training AAAI 2025
SLIP: Spoof-Aware One-Class Face Anti-Spoofing with Language Image Pretraining AAAI 2025
LDP: Generalizing to Multilingual Visual Information Extraction by Language Decoupled Pretraining AAAI 2025
PanAdapter: Two-Stage Fine-Tuning with Spatial-Spectral Priors Injecting for Pansharpening AAAI 2025
OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching ACL 2025
Predicting Fine-tuned Performance on Larger Datasets Before Creating Them COLING 2025
AutoProteinEngine: A Large Language Model Driven Agent Framework for Multimodal AutoML in Protein Engineering COLING 2025
TechExperts(IPN) at GenAI Detection Task 1: Detecting AI-Generated Text in English and Multilingual Contexts COLING 2025
VRCP: Vocabulary Replacement Continued Pretraining for Efficient Multilingual Language Models COLING 2025
A Parameter-Efficient and Fine-Grained Prompt Learning for Vision-Language Models ACL 2025
IMPARA-GED: Grammatical Error Detection is Boosting Reference-free Grammatical Error Quality Estimator ACL 2025
Pretraining Strategies using Monolingual and Parallel Data for Low-Resource Machine Translation ACL 2025
QUESPA Submission for the IWSLT 2025 Dialectal and Low-resource Speech Translation Task ACL 2025
BUINUS at IWSLT: Evaluating the Impact of Data Augmentation and QLoRA-based Fine-Tuning for Maltese to English Speech Translation ACL 2025
SYSTRAN @ IWSLT 2025 Low-resource track ACL 2025
IIITH-BUT system for IWSLT 2025 low-resource Bhojpuri to Hindi speech translation ACL 2025
AI Tools Can Generate Misculture Visuals! Detecting Prompts Generating Misculture Visuals For Prevention ACL 2025
Single layer tiny Co4 outpaces GPT-2 and GPT-BERT EMNLP 2025
Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key Information EMNLP 2025
TTE: Two Tokens Are Enough to Improve Parameter-Efficient Tuning AAAI 2025