← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

wav2vec-S: Adapting Pre-trained Speech Models for Streaming ACL 2024
From Bottom to Top: Extending the Potential of Parameter Efficient Fine-Tuning EMNLP 2024
i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data NAACL 2024
Self-StrAE at SemEval-2024 Task 1: Making Self-Structuring AutoEncoders Learn More With Less NAACL 2024
Order-Based Pre-training Strategies for Procedural Text Understanding NAACL 2024
Compact Speech Translation Models via Discrete Speech Units Pretraining ACL 2024
HybridBERT - Making BERT Pretraining More Efficient Through Hybrid Mixture of Attention Mechanisms NAACL 2024
Knowledge Acquisition through Continued Pretraining is Difficult: A Case Study on r/AskHistorians ACL 2024
Multimodal Chart Retrieval: A Comparison of Text, Table and Image Based Approaches NAACL 2024
GraSAME: Injecting Token-Level Structural Information to Pretrained Language Models via Graph-guided Self-Attention Mechanism NAACL 2024
Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning ACL 2024
PLIP: Language-Image Pre-training for Person Representation Learning NIPS 2024
Knowlab’s Submission to L+M Shared Task: All you need is continued pretraining of chemistry texts even for molecule captioning ACL 2024
Model Editing by Standard Fine-Tuning ACL 2024
Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data ACL 2024
YNU-HPCC at SemEval-2024 Task 9: Using Pre-trained Language Models with LoRA for Multiple-choice Answering Tasks NAACL 2024
IT-Tuning : Parameter Efficient Information Token Tuning for Language Model ACL 2024
Fine-Tuning a Pre-Trained Wav2Vec2 Model for Automatic Speech Recognition- Experiments with De Zahrar Sproche COLING 2024
Tell Me What’s Next: Textual Foresight for Generic UI Representations ACL 2024
On the Evaluation of Speech Foundation Models for Spoken Language Understanding ACL 2024
A Simple Remedy for Dataset Bias via Self-Influence: A Mislabeled Sample Perspective NIPS 2024
Gender and Language Identification in Multilingual Models of Speech: Exploring the Genericity and Robustness of Speech Representations INTERSPEECH 2024
Uncovering Syllable Constituents in the Self-Attention-Based Speech Representations of Whisper EMNLP 2024
ReactXT: Understanding Molecular “Reaction-ship” via Reaction-Contextualized Molecule-Text Pretraining ACL 2024
DecorateLM: Data Engineering through Corpus Rating, Tagging, and Editing with Language Models EMNLP 2024