conftrace_

pre-trained language model

1515 papers

Explore in graph

Also known as

PLMS PTLM PRLM

Co-occurring keywords

transfer learning (5449) text classification (6793) language model (4599) pretrained language model (1030) named entity recognition (2813) few-shot learning (3398) contrastive learning (4032) domain adaptation (4595) representation learning (6206) knowledge distillation (3725)

Papers

UNBERT: User-News Matching BERT for News Recommendation IJCAI 2021
AStarTwice at SemEval-2021 Task 5: Toxic Span Detection Using RoBERTa-CRF, Domain Specific Pre-Training and Self-Training ACL 2021
MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection ACL 2021
YoungSheldon at SemEval-2021 Task 5: Fine-tuning Pre-trained Language Models for Toxic Spans Detection using Token classification Objective ACL 2021
MinD at SemEval-2021 Task 6: Propaganda Detection using Transfer Learning and Multimodal Fusion ACL 2021
DeepBlueAI at SemEval-2021 Task 7: Detecting and Rating Humor and Offense with Stacking Diverse Language Model-Based Methods ACL 2021
hub at SemEval-2021 Task 7: Fusion of ALBERT and Word Frequency Information Detecting and Rating Humor and Offense ACL 2021
YoungSheldon at SemEval-2021 Task 7: Fine-tuning Is All You Need ACL 2021
Rakuten’s Participation in WAT 2021: Examining the Effectiveness of Pre-trained Models for Multilingual and Multimodal Machine Translation ACL 2021
Can Generative Pre-trained Language Models Serve As Knowledge Bases for Closed-book QA? ACL 2021
Towards Table-to-Text Generation with Numerical Reasoning ACL 2021
Novel Natural Language Summarization of Program Code via Leveraging Multiple Input Representations EMNLP 2021
AttentionRank: Unsupervised Keyphrase Extraction using Self and Cross Attentions EMNLP 2021
SideControl: Controlled Open-domain Dialogue Generation via Additive Side Networks EMNLP 2021
Learning and Evaluating a Differentially Private Pre-trained Language Model EMNLP 2021
Self-training with Few-shot Rationalization EMNLP 2021
WVOQ at SemEval-2021 Task 6: BART for Span Detection and Classification ACL 2021
NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application EMNLP 2021
Distilling Word Meaning in Context from Pre-trained Language Models EMNLP 2021
Improving End-to-End Task-Oriented Dialog System with A Simple Auxiliary Task EMNLP 2021
GiBERT: Enhancing BERT with Linguistic Information using a Lightweight Gated Injection Method EMNLP 2021
ARMAN: Pre-training with Semantically Selecting and Reordering of Sentences for Persian Abstractive Summarization EMNLP 2021
Simultaneously Self-Attending to Text and Entities for Knowledge-Informed Text Representations ACL 2021
IIE-NLP-Eyas at SemEval-2021 Task 4: Enhancing PLM for ReCAM with Special Tokens, Re-Ranking, Siamese Encoders and Back Translation ACL 2021
YNU-HPCC at SemEval-2021 Task 11: Using a BERT Model to Extract Contributions from NLP Scholarly Articles ACL 2021