← Techniques
Deep Learning › Techniques ›

Pretraining

2471 directly classified papers

Papers per year

Papers

Multilingual Machine Translation Evaluation Metrics Fine-tuned on Pseudo-Negative Examples for WMT 2021 Metrics Task EMNLP 2021
PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation ACL 2021
eMLM: A New Pre-training Objective for Emotion Related Tasks ACL 2021
Investigating Pretrained Language Models for Graph-to-Text Generation EMNLP 2021
AuGPT: Auxiliary Tasks and Data Augmentation for End-To-End Dialogue with Pre-Trained Language Models EMNLP 2021
HumorHunter at SemEval-2021 Task 7: Humor and Offense Recognition with Disentangled Attention IJCNLP 2021
OCHADAI at SMM4H-2021 Task 5: Classifying self-reporting tweets on potential cases of COVID-19 by ensembling pre-trained language models NAACL 2021
Leveraging Pretrained Models for Automatic Summarization of Doctor-Patient Conversations EMNLP 2021
Does Pretraining for Summarization Require Knowledge Transfer? EMNLP 2021
Boundary-Sensitive Pre-Training for Temporal Localization in Videos ICCV 2021
Span Fine-tuning for Pre-trained Language Models EMNLP 2021
Multidomain Pretrained Language Models for Green NLP EACL 2021
abcbpc at SemEval-2021 Task 7: ERNIE-based Multi-task Model for Detecting and Rating Humor and Offense IJCNLP 2021
SarcasmDet at SemEval-2021 Task 7: Detect Humor and Offensive based on Demographic Factors using RoBERTa Pre-trained Model IJCNLP 2021
On Equivariant and Invariant Learning of Object Landmark Representations ICCV 2021
ERNIE-ViL: Knowledge Enhanced Vision-Language Representations through Scene Graphs AAAI 2021
The Power of Scale for Parameter-Efficient Prompt Tuning EMNLP 2021
Learning Bill Similarity with Annotated and Augmented Corpora of Bills EMNLP 2021
KLMo: Knowledge Graph Enhanced Pretrained Language Model with Fine-Grained Relationships EMNLP 2021
SU-NLP at CASE 2021 Task 1: Protest News Detection for English ACL 2021
Segatron: Segment-Aware Transformer for Language Modeling and Understanding AAAI 2021
INNOVATORS at SemEval-2021 Task-11: A Dependency Parsing and BERT-based model for Extracting Contribution Knowledge from Scientific Papers ACL 2021
Fused Acoustic and Text Encoding for Multimodal Bilingual Pretraining and Speech Translation ICML 2021
Team JARS: DialDoc Subtask 1 - Improved Knowledge Identification with Supervised Out-of-Domain Pretraining ACL 2021
CS-BERT: a pretrained model for customer service dialogues EMNLP 2021