← Models
Deep Learning › Models ›

Language Models

705 directly classified papers

Papers per year

Papers

Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus EMNLP 2021
Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning NIPS 2021
IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization AAAI 2021
Learning from History: Modeling Temporal Knowledge Graphs with Sequential Copy-Generation Networks AAAI 2021
Measure and Evaluation of Semantic Divergence across Two Languages ACL 2021
What Context Features Can Transformer Language Models Use? ACL 2021
BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Data ACL 2021
Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models EMNLP 2021
The Impact of Positional Encodings on Multilingual Compression EMNLP 2021
Do Long-Range Language Models Actually Use Long-Range Context? EMNLP 2021
Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories EMNLP 2021
Relational World Knowledge Representation in Contextual Language Models: A Review EMNLP 2021
How much pretraining data do language models need to learn syntax? EMNLP 2021
Sorting through the noise: Testing robustness of information processing in pre-trained language models EMNLP 2021
You should evaluate your language model on marginal likelihood over tokenisations EMNLP 2021
APIRecX: Cross-Library API Recommendation via Pre-Trained Language Model EMNLP 2021
Chinese WPLC: A Chinese Dataset for Evaluating Pretrained Language Models on Word Prediction Given Long-Range Context EMNLP 2021
Structural Adapters in Pretrained Language Models for AMR-to-Text Generation EMNLP 2021
Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT EMNLP 2021
Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach EMNLP 2021
Controlled Evaluation of Grammatical Knowledge in Mandarin Chinese Language Models EMNLP 2021
NegatER: Unsupervised Discovery of Negatives in Commonsense Knowledge Bases EMNLP 2021
IGA: An Intent-Guided Authoring Assistant EMNLP 2021
BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation EMNLP 2021
Generating Datasets with Pretrained Language Models EMNLP 2021