conftrace_
← Techniques
Deep Learning › Techniques ›

Pretraining

2,483 papers

Papers per year

1
5
219
374
'10
'15
'20
'25

Papers

FINDINGS OF THE IWSLT 2021 EVALUATION CAMPAIGN IJCNLP 2021
Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models IJCNLP 2021
Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup IJCNLP 2021
TA-MAMC at SemEval-2021 Task 4: Task-adaptive Pretraining and Multi-head Attention for Abstract Meaning Reading Comprehension IJCNLP 2021
Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation IJCNLP 2021
HumorHunter at SemEval-2021 Task 7: Humor and Offense Recognition with Disentangled Attention IJCNLP 2021
abcbpc at SemEval-2021 Task 7: ERNIE-based Multi-task Model for Detecting and Rating Humor and Offense IJCNLP 2021
SarcasmDet at SemEval-2021 Task 7: Detect Humor and Offensive based on Demographic Factors using RoBERTa Pre-trained Model IJCNLP 2021
UPB at SemEval-2021 Task 1: Combining Deep Learning and Hand-Crafted Features for Lexical Complexity Prediction IJCNLP 2021
JUST-BLUE at SemEval-2021 Task 1: Predicting Lexical Complexity using BERT and RoBERTa Pre-trained Language Models IJCNLP 2021
BigGreen at SemEval-2021 Task 1: Lexical Complexity Prediction with Assembly Models IJCNLP 2021
SkoltechNLP at SemEval-2021 Task 5: Leveraging Sentence-level Pre-training for Toxic Span Detection IJCNLP 2021
BennettNLP at SemEval-2021 Task 5: Toxic Spans Detection using Stacked Embedding Powered Toxic Entity Recognizer IJCNLP 2021
UoT-UWF-PartAI at SemEval-2021 Task 5: Self Attention Based Bi-GRU with Multi-Embedding Representation for Toxicity Highlighter IJCNLP 2021
HLE-UPC at SemEval-2021 Task 5: Multi-Depth DistilBERT for Toxic Spans Detection IJCNLP 2021
LZ1904 at SemEval-2021 Task 5: Bi-LSTM-CRF for Toxic Span Detection using Pretrained Word Embedding IJCNLP 2021
ES-JUST at SemEval-2021 Task 7: Detecting and Rating Humor and Offensive Text Using Deep Learning IJCNLP 2021
IIITH at SemEval-2021 Task 7: Leveraging transformer-based humourous and offensive text detection architectures using lexical and hurtlex features and task adaptive pretraining IJCNLP 2021
FII FUNNY at SemEval-2021 Task 7: HaHackathon: Detecting and rating Humor and Offense IJCNLP 2021
Inducing Language-Agnostic Multilingual Representations IJCNLP 2021
NICT-2 Translation System at WAT-2021: Applying a Pretrained Multilingual Encoder-Decoder Model to Low-resource Language Pairs IJCNLP 2021
TMU NMT System with Japanese BART for the Patent task of WAT 2021 IJCNLP 2021
A Study into Pre-Training Strategies for Spoken Language Understanding on Dysarthric Speech INTERSPEECH 2021
Improving Perceptual Quality by Phone-Fortified Perceptual Loss Using Wasserstein Distance for Speech Enhancement INTERSPEECH 2021
Visual Transformers for Primates Classification and Covid Detection INTERSPEECH 2021