conftrace_

pre-trained language model

1515 papers

Explore in graph

Also known as

PLMS PTLM PRLM

Co-occurring keywords

transfer learning (5449) text classification (6793) language model (4599) pretrained language model (1030) named entity recognition (2813) few-shot learning (3398) contrastive learning (4032) domain adaptation (4595) representation learning (6206) knowledge distillation (3725)

Papers

Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-Trained Language Models EMNLP 2020
Train No Evil: Selective Masking for Task-Guided Pre-Training EMNLP 2020
BERTweet: A pre-trained language model for English Tweets EMNLP 2020
Adapting BERT for Word Sense Disambiguation with Gloss Selection Objective and Example Sentences EMNLP 2020
A Unified Model for Financial Event Classification, Detection and Summarization IJCAI 2020
SentiX: A Sentiment-Aware Pre-Trained Model for Cross-Domain Sentiment Analysis COLING 2020
CharBERT: Character-aware Pre-trained Language Model COLING 2020
Combining BERT with Static Word Embeddings for Categorizing Social Media EMNLP 2020
Feature Adaptation of Pre-Trained Language Models across Languages and Domains with Robust Self-Training EMNLP 2020
DATAMAFIA at WNUT-2020 Task 2: A Study of Pre-trained Language Models along with Regularization Techniques for Downstream Tasks EMNLP 2020
IIE-NLP-NUT at SemEval-2020 Task 4: Guiding PLM with Prompt Template Reconstruction Strategy for ComVE SEMEVAL 2020
Smash at SemEval-2020 Task 7: Optimizing the Hyperparameters of ERNIE 2.0 for Humor Ranking and Rating SEMEVAL 2020
Kungfupanda at SemEval-2020 Task 12: BERT-Based Multi-TaskLearning for Offensive Language Detection SEMEVAL 2020
TextLearner at SemEval-2020 Task 10: A Contextualized Ranking System in Solving Emphasis Selection in Text SEMEVAL 2020
Hitachi at SemEval-2020 Task 10: Emphasis Distribution Fusion on Fine-Tuned Language Models SEMEVAL 2020
UHH-LT at SemEval-2020 Task 12: Fine-Tuning of Pre-Trained Transformer Networks for Offensive Language Detection SEMEVAL 2020
Active Sentence Learning by Adversarial Uncertainty Sampling in Discrete Space EMNLP 2020
ERNIE at SemEval-2020 Task 10: Learning Word Emphasis Selection by Pre-trained Language Model SEMEVAL 2020
MPNet: Masked and Permuted Pre-training for Language Understanding NIPS 2020
Revisiting Pre-Trained Models for Chinese Natural Language Processing EMNLP 2020
Style Attuned Pre-Training and Parameter Efficient Fine-Tuning for Spoken Language Understanding INTERSPEECH 2020
Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification Using Pre-trained Language Models SEMEVAL 2020
IDS at SemEval-2020 Task 10: Does Pre-trained Language Model Know What to Emphasize? SEMEVAL 2020
BERT Enhanced Neural Machine Translation and Sequence Tagging Model for Chinese Grammatical Error Diagnosis AACL 2020
Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge NIPS 2020