← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Knowledge is a Region in Weight Space for Fine-tuned Language Models EMNLP 2023
Breaking Boundaries in Retrieval Systems: Unsupervised Domain Adaptation with Denoise-Finetuning EMNLP 2023
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations EMNLP 2023
Automated De-Identification of Arabic Medical Records EMNLP 2023
Automatic Evaluation of Generative Models with Instruction Tuning EMNLP 2023
Multi-domain Summarization from Leaderboards to Practice: Re-examining Automatic and Human Evaluation EMNLP 2023
Long Text Classification using Transformers with Paragraph Selection Strategies EMNLP 2023
AIST AIRC Submissions to the WMT23 Shared Task EMNLP 2023
The MAKE-NMTVIZ System Description for the WMT23 Literary Task EMNLP 2023
PSST! Prosodic Speech Segmentation with Transformers EMNLP 2023
Query-as-context Pre-training for Dense Passage Retrieval EMNLP 2023
Prompt, Generate, Then Cache: Cascade of Foundation Models Makes Strong Few-Shot Learners CVPR 2023
VideoMAE V2: Scaling Video Masked Autoencoders With Dual Masking CVPR 2023
Learning Instance-Level Representation for Large-Scale Multi-Modal Pretraining in E-Commerce CVPR 2023
MixMAE: Mixed and Masked Autoencoder for Efficient Pretraining of Hierarchical Vision Transformers CVPR 2023
Probing Sentiment-Oriented Pre-Training Inspired by Human Sentiment Perception Mechanism CVPR 2023
TOPLight: Lightweight Neural Networks With Task-Oriented Pretraining for Visible-Infrared Recognition CVPR 2023
Improving Pixel-based MIM by Reducing Wasted Modeling Capability ICCV 2023
Unleashing Vanilla Vision Transformer with Masked Image Modeling for Object Detection ICCV 2023
Long-range Multimodal Pretraining for Movie Understanding ICCV 2023
Modelling Political Aggression on Social Media Platforms ACL 2023
Fine-tuning mSLAM for the SIGMORPHON 2022 Shared Task on Grapheme-to-Phoneme Conversion ACL 2023
A Meta-dataset of German Medical Corpora: Harmonization of Annotations and Cross-corpus NER Evaluation ACL 2023
MRM: Masked Relation Modeling for Medical Image Pre-Training with Genetics ICCV 2023
Towards Parameter-Efficient Integration of Pre-Trained Language Models In Temporal Video Grounding ACL 2023