Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Entity-level Cross-modal Learning Improves Multi-modal Machine Translation EMNLP 2021

AMuSE-WSD: An All-in-one Multilingual System for Easy Word Sense Disambiguation EMNLP 2021

IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization EMNLP 2021

FAME: Feature-Based Adversarial Meta-Embeddings for Robust Input Representations EMNLP 2021

Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach EMNLP 2021

Improving Neural Machine Translation by Bidirectional Training EMNLP 2021

How much pretraining data do language models need to learn syntax? EMNLP 2021

BigGreen at SemEval-2021 Task 1: Lexical Complexity Prediction with Assembly Models IJCNLP 2021

1213Li at SemEval-2021 Task 6: Detection of Propaganda with Multi-modal Attention and Pre-trained Models ACL 2021

NLyticsFKIE at SemEval-2021 Task 6: Detection of Persuasion Techniques In Texts And Images ACL 2021

Optimizing Deeper Transformers on Small Datasets IJCNLP 2021

Composed Fine-Tuning: Freezing Pre-Trained Denoising Autoencoders for Improved Generalization ICML 2021

Self-Supervised 3D Skeleton Action Representation Learning With Motion Consistency and Continuity ICCV 2021

Stage-wise Fine-tuning for Graph-to-Text Generation IJCNLP 2021

UoT-UWF-PartAI at SemEval-2021 Task 5: Self Attention Based Bi-GRU with Multi-Embedding Representation for Toxicity Highlighter IJCNLP 2021

E(n) Equivariant Graph Neural Networks ICML 2021

Whitening for Self-Supervised Representation Learning ICML 2021

MeshTalk: 3D Face Animation From Speech Using Cross-Modality Disentanglement ICCV 2021

CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation EMNLP 2021

TADPOLE: Task ADapted Pre-Training via AnOmaLy DEtection EMNLP 2021

Condenser: a Pre-training Architecture for Dense Retrieval EMNLP 2021

N-ImageNet: Towards Robust, Fine-Grained Object Recognition With Event Cameras ICCV 2021

HLE-UPC at SemEval-2021 Task 5: Multi-Depth DistilBERT for Toxic Spans Detection IJCNLP 2021

Data-Efficient Language Shaped Few-shot Image Classification EMNLP 2021

Novel Natural Language Summarization of Program Code via Leveraging Multiple Input Representations EMNLP 2021