← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Deep Bidirectional Language-Knowledge Graph Pretraining NIPS 2022
Insights into Pre-training via Simpler Synthetic Tasks NIPS 2022
Multi-Lingual Acquisition on Multimodal Pre-training for Cross-modal Retrieval NIPS 2022
A Second Wave of UD Hebrew Treebanking and Cross-Domain Parsing EMNLP 2022
Unsupervised Boundary-Aware Language Model Pretraining for Chinese Sequence Labeling EMNLP 2022
Impact of Sequence Length and Copying on Clause-Level Inflection EMNLP 2022
Efficient Zero-shot Event Extraction with Context-Definition Alignment EMNLP 2022
LTRC @ Causal News Corpus 2022: Extracting and Identifying Causal Elements using Adapters EMNLP 2022
EndTimes at SemEval-2021 Task 7: Detecting and Rating Humor and Offense with BERT and Ensembles ACL 2021
FII FUNNY at SemEval-2021 Task 7: HaHackathon: Detecting and rating Humor and Offense IJCNLP 2021
C3SL at SemEval-2021 Task 1: Predicting Lexical Complexity of Words in Specific Contexts with Sentence Embeddings ACL 2021
Efficient Visual Pretraining With Contrastive Detection ICCV 2021
Multi-Level Curriculum for Training a Distortion-Aware Barrel Distortion Rectification Model ICCV 2021
EventHPE: Event-Based 3D Human Pose and Shape Estimation ICCV 2021
Alpha at SemEval-2021 Task 6: Transformer Based Propaganda Classification ACL 2021
An Efficient Streaming Non-Recurrent On-Device End-to-End Model with Improvements to Rare-Word Modeling INTERSPEECH 2021
Visual Transformers for Primates Classification and Covid Detection INTERSPEECH 2021
HMM-Free Encoder Pre-Training for Streaming RNN Transducer INTERSPEECH 2021
Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation SEMEVAL 2021
JUST-BLUE at SemEval-2021 Task 1: Predicting Lexical Complexity using BERT and RoBERTa Pre-trained Language Models SEMEVAL 2021
Entity at SemEval-2021 Task 5: Weakly Supervised Token Labelling for Toxic Spans Detection SEMEVAL 2021
INNOVATORS at SemEval-2021 Task-11: A Dependency Parsing and BERT-based model for Extracting Contribution Knowledge from Scientific Papers SEMEVAL 2021
Implicit Premise Generation with Discourse-aware Commonsense Knowledge Models EMNLP 2021
Revisiting Pivot-Based Paraphrase Generation: Language Is Not the Only Optional Pivot EMNLP 2021
Topic Transferable Table Question Answering EMNLP 2021