← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Pri3D: Can 3D Priors Help 2D Representation Learning? ICCV 2021
Graph-Based Asynchronous Event Processing for Rapid Object Recognition ICCV 2021
TreeBERT: A tree-based pre-trained model for programming language UAI 2021
Visually-Grounded Library of Behaviors for Manipulating Diverse Objects across Diverse Configurations and Views CORL 2021
Recent advances in neural metaphor processing: A linguistic, cognitive and social perspective NAACL 2021
BERTAC: Enhancing Transformer-based Language Models with Adversarially Pretrained Convolutional Neural Networks ACL 2021
Making Pre-trained Language Models Better Few-shot Learners ACL 2021
Long Document Summarization in a Low Resource Setting using Pretrained Language Models ACL 2021
CRSLab: An Open-Source Toolkit for Building Conversational Recommender System ACL 2021
Team “NoConflict” at CASE 2021 Task 1: Pretraining for Sentence-Level Protest Event Detection ACL 2021
TA-MAMC at SemEval-2021 Task 4: Task-adaptive Pretraining and Multi-head Attention for Abstract Meaning Reading Comprehension ACL 2021
Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation ACL 2021
HumorHunter at SemEval-2021 Task 7: Humor and Offense Recognition with Disentangled Attention ACL 2021
abcbpc at SemEval-2021 Task 7: ERNIE-based Multi-task Model for Detecting and Rating Humor and Offense ACL 2021
SarcasmDet at SemEval-2021 Task 7: Detect Humor and Offensive based on Demographic Factors using RoBERTa Pre-trained Model ACL 2021
JUST-BLUE at SemEval-2021 Task 1: Predicting Lexical Complexity using BERT and RoBERTa Pre-trained Language Models ACL 2021
FII FUNNY at SemEval-2021 Task 7: HaHackathon: Detecting and rating Humor and Offense ACL 2021
Domain-Adaptive Pretraining Methods for Dialogue Understanding IJCNLP 2021
TMU NMT System with Japanese BART for the Patent task of WAT 2021 IJCNLP 2021
Attending Self-Attention: A Case Study of Visually Grounded Supervision in Vision-and-Language Transformers IJCNLP 2021
IIITH at SemEval-2021 Task 7: Leveraging transformer-based humourous and offensive text detection architectures using lexical and hurtlex features and task adaptive pretraining IJCNLP 2021
NICT-2 Translation System at WAT-2021: Applying a Pretrained Multilingual Encoder-Decoder Model to Low-resource Language Pairs IJCNLP 2021
Predicting pragmatic discourse features in the language of adults with autism spectrum disorder IJCNLP 2021
How to Adapt Your Pretrained Multilingual Model to 1600 Languages IJCNLP 2021
Making Pre-trained Language Models Better Few-shot Learners IJCNLP 2021