← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

DeepZensols: A Deep Learning Natural Language Processing Framework for Experimentation and Reproducibility EMNLP 2023
BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessing NSDI 2023
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning NIPS 2023
TableVLM: Multi-modal Pre-training for Table Structure Recognition ACL 2023
ProsAudit, a prosodic benchmark for self-supervised speech models INTERSPEECH 2023
ABC-KD: Attention-Based-Compression Knowledge Distillation for Deep Learning-Based Noise Suppression INTERSPEECH 2023
Probing Speech Quality Information in ASR Systems INTERSPEECH 2023
Advances in Language Recognition in Low Resource African Languages: The JHU-MIT Submission for NIST LRE22 INTERSPEECH 2023
On “Scientific Debt” in NLP: A Case for More Rigour in Language Model Pre-Training Research ACL 2023
WSPAlign: Word Alignment Pre-training via Large-Scale Weakly Supervised Span Prediction ACL 2023
A Closer Look at Self-Supervised Lightweight Vision Transformers ICML 2023
Magneto: A Foundation Transformer ICML 2023
STEPs: Self-Supervised Key Step Extraction and Localization from Unlabeled Procedural Videos ICCV 2023
Generative Pretraining for Black-Box Optimization ICML 2023
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video ICML 2023
UFAL-ULD at BLP-2023 Task 1: Violence Detection in Bangla Text EMNLP 2023
ModelKeeper: Accelerating DNN Training via Automated Training Warmup NSDI 2023
Federated Learning Over Images: Vertical Decompositions and Pre-Trained Backbones Are Difficult to Beat ICCV 2023
HoneyBee: Progressive Instruction Finetuning of Large Language Models for Materials Science EMNLP 2023
Learning to Correct Noisy Labels for Fine-Grained Entity Typing via Co-Prediction Prompt Tuning EMNLP 2023
Co2PT: Mitigating Bias in Pre-trained Language Models through Counterfactual Contrastive Prompt Tuning EMNLP 2023
Dynamic Stance: Modeling Discussions by Labeling the Interactions EMNLP 2023
PUNR: Pre-training with User Behavior Modeling for News Recommendation EMNLP 2023
InstructSafety: A Unified Framework for Building Multidimensional and Explainable Safety Detector through Instruction Tuning EMNLP 2023
Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning EMNLP 2023