← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

SeqMatchNet: Contrastive Learning with Sequence Matching for Place Recognition & Relocalization CORL 2021
BigGreen at SemEval-2021 Task 1: Lexical Complexity Prediction with Assembly Models ACL 2021
LIIR at SemEval-2021 task 6: Detection of Persuasion Techniques In Texts and Images using CLIP features ACL 2021
Hate Speech Detection Based on Sentiment Knowledge Sharing ACL 2021
CS-UM6P at SemEval-2021 Task 1: A Deep Learning Model-based Pre-trained Transformer Encoder for Lexical Complexity ACL 2021
Wav-BERT: Cooperative Acoustic and Linguistic Representation Learning for Low-Resource Speech Recognition EMNLP 2021
YNU-HPCC at SemEval-2021 Task 5: Using a Transformer-based Model with Auxiliary Information for Toxic Span Detection SEMEVAL 2021
TorontoCL at CMCL 2021 Shared Task: RoBERTa with Multi-Stage Fine-Tuning for Eye-Tracking Prediction NAACL 2021
A Simple Approach for Handling Out-of-Vocabulary Identifiers in Deep Learning for Source Code NAACL 2021
Volta at SemEval-2021 Task 6: Towards Detecting Persuasive Texts and Images using Textual and Multimodal Ensemble ACL 2021
ES-JUST at SemEval-2021 Task 7: Detecting and Rating Humor and Offensive Text Using Deep Learning ACL 2021
NeurST: Neural Speech Translation Toolkit ACL 2021
S-NLP at SemEval-2021 Task 5: An Analysis of Dual Networks for Sequence Tagging ACL 2021
UPB at SemEval-2021 Task 1: Combining Deep Learning and Hand-Crafted Features for Lexical Complexity Prediction IJCNLP 2021
ES-JUST at SemEval-2021 Task 7: Detecting and Rating Humor and Offensive Text Using Deep Learning IJCNLP 2021
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining NIPS 2021
Dense Keypoints via Multiview Supervision NIPS 2021
Distributed Deep Learning In Open Collaborations NIPS 2021
Physics-Aware Downsampling with Deep Learning for Scalable Flood Modeling NIPS 2021
Fast Training of Neural Lumigraph Representations using Meta Learning NIPS 2021
Language Model Pretraining and Transfer Learning for Very Low Resource Languages EMNLP 2021
Glyph Enhanced Chinese Character Pre-Training for Lexical Sememe Prediction EMNLP 2021
Char2Subword: Extending the Subword Embedding Space Using Robust Character Compositionality EMNLP 2021
Effective Sequence-to-Sequence Dialogue State Tracking EMNLP 2021
Contrastive Code Representation Learning EMNLP 2021