conftrace_

pre-trained language model

1515 papers

Explore in graph

Also known as

PLMS PTLM PRLM

Co-occurring keywords

transfer learning (5449) text classification (6793) language model (4599) pretrained language model (1030) named entity recognition (2813) few-shot learning (3398) contrastive learning (4032) domain adaptation (4595) representation learning (6206) knowledge distillation (3725)

Papers

HumorHunter at SemEval-2021 Task 7: Humor and Offense Recognition with Disentangled Attention IJCNLP 2021
Sorting through the noise: Testing robustness of information processing in pre-trained language models EMNLP 2021
Extract, Denoise and Enforce: Evaluating and Improving Concept Preservation for Text-to-Text Generation EMNLP 2021
PDALN: Progressive Domain Adaptation over a Pre-trained Model for Low-Resource Cross-Domain Named Entity Recognition EMNLP 2021
ReasonBERT: Pre-trained to Reason with Distant Supervision EMNLP 2021
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms EMNLP 2021
BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief EMNLP 2021
DialDoc 2021 Shared Task: Goal-Oriented Document-grounded Dialogue Modeling ACL 2021
Sattiy at SemEval-2021 Task 9: An Ensemble Solution for Statement Verification and Evidence Finding with Tables ACL 2021
UoR at SemEval-2021 Task 7: Utilizing Pre-trained DistilBERT Model and Multi-scale CNN for Humor Detection ACL 2021
CommitBERT: Commit Message Generation Using Pre-Trained Programming Language Model IJCNLP 2021
CoTexT: Multi-task Learning with Code-Text Transformer IJCNLP 2021
Probing Multilingual Language Models for Discourse IJCNLP 2021
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce EMNLP 2021
Condenser: a Pre-training Architecture for Dense Retrieval EMNLP 2021
Semantics-Aware Inferential Network for Natural Language Understanding AAAI 2021
DeepBlueAI at TextGraphs 2021 Shared Task: Treating Multi-Hop Inference Explanation Regeneration as A Ranking Problem NAACL 2021
Preserving Cross-Linguality of Pre-trained Models via Continual Learning IJCNLP 2021
OCHADAI at SMM4H-2021 Task 5: Classifying self-reporting tweets on potential cases of COVID-19 by ensembling pre-trained language models NAACL 2021
SalKG: Learning From Knowledge Graph Explanations for Commonsense Reasoning NIPS 2021
Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning NIPS 2021
CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understanding IJCNLP 2021
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation IJCNLP 2021
Lexicon Enhanced Chinese Sequence Labeling Using BERT Adapter ACL 2021
Challenges for Information Extraction from Dialogue in Criminal Law ACL 2021