conftrace_

pre-trained language model

1515 papers

Explore in graph

Also known as

PLMS PTLM PRLM

Co-occurring keywords

transfer learning (5449) text classification (6793) language model (4599) pretrained language model (1030) named entity recognition (2813) few-shot learning (3398) contrastive learning (4032) domain adaptation (4595) representation learning (6206) knowledge distillation (3725)

Papers

Cambridge at SemEval-2021 Task 2: Neural WiC-Model with Data Augmentation and Exploration of Representation ACL 2021
YoungSheldon at SemEval-2021 Task 7: Fine-tuning Is All You Need SEMEVAL 2021
UniParma at SemEval-2021 Task 5: Toxic Spans Detection Using CharacterBERT and Bag-of-Words Model IJCNLP 2021
UoB at SemEval-2021 Task 5: Extending Pre-Trained Language Models to Include Task and Domain-Specific Information for Toxic Span Prediction IJCNLP 2021
KGP at SemEval-2021 Task 8: Leveraging Multi-Staged Language Models for Extracting Measurements, their Attributes and Relations IJCNLP 2021
MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection IJCNLP 2021
YoungSheldon at SemEval-2021 Task 5: Fine-tuning Pre-trained Language Models for Toxic Spans Detection using Token classification Objective IJCNLP 2021
MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection SEMEVAL 2021
Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization IJCNLP 2021
ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation IJCNLP 2021
KuiLeiXi: a Chinese Open-Ended Text Adventure Game IJCNLP 2021
MVP-BERT: Multi-Vocab Pre-training for Chinese BERT IJCNLP 2021
Using Adversarial Attacks to Reveal the Statistical Bias in Machine Reading Comprehension Models IJCNLP 2021
ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic IJCNLP 2021
TIMEDIAL: Temporal Commonsense Reasoning in Dialog IJCNLP 2021
GhostBERT: Generate More Features with Cheap Operations for BERT IJCNLP 2021
CLEVE: Contrastive Pre-training for Event Extraction IJCNLP 2021
AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models IJCNLP 2021
Probing Toxic Content in Large Pre-Trained Language Models IJCNLP 2021
MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understanding IJCNLP 2021
Can Generative Pre-trained Language Models Serve As Knowledge Bases for Closed-book QA? IJCNLP 2021
PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction IJCNLP 2021
Selecting Informative Contexts Improves Language Model Fine-tuning IJCNLP 2021
Mention Flags (MF): Constraining Transformer-based Text Generators IJCNLP 2021
Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates EACL 2021