← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

RiddleMasters at SemEval-2024 Task 9: Comparing Instruction Fine-tuning with Zero-Shot Approaches NAACL 2024
A Pretrainer’s Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity NAACL 2024
PLIP: Language-Image Pre-training for Person Representation Learning NIPS 2024
Visually Guided Generative Text-Layout Pre-training for Document Intelligence NAACL 2024
HybridBERT - Making BERT Pretraining More Efficient Through Hybrid Mixture of Attention Mechanisms NAACL 2024
GraSAME: Injecting Token-Level Structural Information to Pretrained Language Models via Graph-guided Self-Attention Mechanism NAACL 2024
YNU-HPCC at SemEval-2024 Task 9: Using Pre-trained Language Models with LoRA for Multiple-choice Answering Tasks NAACL 2024
A Simple Remedy for Dataset Bias via Self-Influence: A Mislabeled Sample Perspective NIPS 2024
Gender and Language Identification in Multilingual Models of Speech: Exploring the Genericity and Robustness of Speech Representations INTERSPEECH 2024
Multimodal Chart Retrieval: A Comparison of Text, Table and Image Based Approaches NAACL 2024
Order-Based Pre-training Strategies for Procedural Text Understanding NAACL 2024
UMUTeam at SemEval-2024 Task 8: Combining Transformers and Syntax Features for Machine-Generated Text Detection NAACL 2024
i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data NAACL 2024
EVil-Probe - a Composite Benchmark for Extensive Visio-Linguistic Probing COLING 2024
Interface Design for Self-Supervised Speech Models INTERSPEECH 2024
AQuA – Combining Experts’ and Non-Experts’ Views To Assess Deliberation Quality in Online Discussions Using LLMs COLING 2024
ASOS at OSACT6 Shared Task: Investigation of Data Augmentation in Arabic Dialect-MSA Translation COLING 2024
Distilling CLIP with Dual Guidance for Learning Discriminative Human Body Shape Representation CVPR 2024
Audiocite.net : A Large Spoken Read Dataset in French COLING 2024
TCP:Textual-based Class-aware Prompt tuning for Visual-Language Model CVPR 2024
DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Vision CVPR 2024
IT5: Text-to-text Pretraining for Italian Language Understanding and Generation COLING 2024
SRIB-NMT’s Submission to the Indic MT Shared Task in WMT 2024 EMNLP 2024
Initializing Variable-sized Vision Transformers from Learngene with Learnable Transformation NIPS 2024
PIN: Positional Insert Unlocks Object Localisation Abilities in VLMs CVPR 2024