conftrace_

pre-trained language model

1515 papers

Explore in graph

Also known as

PLMS PTLM PRLM

Co-occurring keywords

transfer learning (5449) text classification (6793) language model (4599) pretrained language model (1030) named entity recognition (2813) few-shot learning (3398) contrastive learning (4032) domain adaptation (4595) representation learning (6206) knowledge distillation (3725)

Papers

BioMegatron: Larger Biomedical Domain Language Model EMNLP 2020
On the Sentence Embeddings from Pre-trained Language Models EMNLP 2020
Attending to Entities for Better Text Understanding AAAI 2020
Importance-Aware Learning for Neural Headline Editing AAAI 2020
Towards Minimal Supervision BERT-Based Grammar Error Correction (Student Abstract) AAAI 2020
POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training EMNLP 2020
Disfluencies and Fine-Tuning Pre-Trained Language Models for Detection of Alzheimer’s Disease INTERSPEECH 2020
Substance over Style: Document-Level Targeted Content Transfer EMNLP 2020
IDSOU at WNUT-2020 Task 2: Identification of Informative COVID-19 English Tweets EMNLP 2020
Speech to Text Adaptation: Towards an Efficient Cross-Modal Distillation INTERSPEECH 2020
ConvBERT: Improving BERT with Span-based Dynamic Convolution NIPS 2020
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers NIPS 2020
Analyzing Individual Neurons in Pre-trained Language Models EMNLP 2020
Distill BERT to Traditional Models in Chinese Machine Reading Comprehension (Student Abstract) AAAI 2020
Modeling Content Importance for Summarization with Pre-trained Language Models EMNLP 2020
Context Analysis for Pre-trained Masked Language Models EMNLP 2020
Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space EMNLP 2020
RethinkCWS: Is Chinese Word Segmentation a Solved Task? EMNLP 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages EMNLP 2020
RobBERT: a Dutch RoBERTa-based Language Model EMNLP 2020
Enhancing Generalization in Natural Language Inference by Syntax EMNLP 2020
HurtBERT: Incorporating Lexical Features with BERT for the Detection of Abusive Language EMNLP 2020
What Happens To BERT Embeddings During Fine-tuning? EMNLP 2020
UIT-HSE at WNUT-2020 Task 2: Exploiting CT-BERT for Identifying COVID-19 Information on the Twitter Social Network EMNLP 2020
ComplexDataLab at W-NUT 2020 Task 2: Detecting Informative COVID-19 Tweets by Attending over Linked Documents EMNLP 2020