conftrace_

pre-trained language model

1515 papers

Explore in graph

Also known as

PLMS PTLM PRLM

Co-occurring keywords

transfer learning (5449) text classification (6793) language model (4599) pretrained language model (1030) named entity recognition (2813) few-shot learning (3398) contrastive learning (4032) domain adaptation (4595) representation learning (6206) knowledge distillation (3725)

Papers

A Context-Dependent Gated Module for Incorporating Symbolic Semantics into Event Coreference Resolution NAACL 2021
COVID-19 Named Entity Recognition for Vietnamese NAACL 2021
Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa NAACL 2021
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models NAACL 2021
Understanding by Understanding Not: Modeling Negation in Language Models NAACL 2021
Neural Language Modeling for Contextualized Temporal Graph Generation NAACL 2021
PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation ACL 2021
UoR at SemEval-2021 Task 4: Using Pre-trained BERT Token Embeddings for Question Answering of Abstract Meaning ACL 2021
CLaC-BP at SemEval-2021 Task 8: SciBERT Plus Rules for MeasEval ACL 2021
StructuralLM: Structural Pre-training for Form Understanding ACL 2021
RedwoodNLP at SemEval-2021 Task 7: Ensembled Pretrained and Lightweight Models for Humor Detection ACL 2021
Thank you BART! Rewarding Pre-Trained Models Improves Formality Style Transfer ACL 2021
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning ACL 2021
Grenzlinie at SemEval-2021 Task 7: Detecting and Rating Humor and Offense SEMEVAL 2021
Towards Table-to-Text Generation with Numerical Reasoning IJCNLP 2021
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning IJCNLP 2021
UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning IJCNLP 2021
IIE-NLP-Eyas at SemEval-2021 Task 4: Enhancing PLM for ReCAM with Special Tokens, Re-Ranking, Siamese Encoders and Back Translation IJCNLP 2021
Simultaneously Self-Attending to Text and Entities for Knowledge-Informed Text Representations IJCNLP 2021
PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation IJCNLP 2021
Applying Occam’s Razor to Transformer-Based Dependency Parsing: What Works, What Doesn’t, and What is Really Necessary IJCNLP 2021
Stage-wise Fine-tuning for Graph-to-Text Generation IJCNLP 2021
Structural Pre-training for Dialogue Comprehension IJCNLP 2021
An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models IJCNLP 2021
abcbpc at SemEval-2021 Task 7: ERNIE-based Multi-task Model for Detecting and Rating Humor and Offense IJCNLP 2021