Language Models

Relating Neural Text Degeneration to Exposure Bias EMNLP 2021 Relational World Knowledge Representation in Contextual Language Models: A Review EMNLP 2021 Rethinking Embedding Coupling in Pre-trained Language Models ICLR 2021 Sorting through the noise: Testing robustness of information processing in pre-trained language models EMNLP 2021 Stage-wise Fine-tuning for Graph-to-Text Generation ACL 2021 Structural Adapters in Pretrained Language Models for AMR-to-Text Generation EMNLP 2021 Structural Pre-training for Dialogue Comprehension ACL 2021 Surface Form Competition: Why the Highest Probability Answer Isn’t Always Right EMNLP 2021 Team Enigma at ArgMining-EMNLP 2021: Leveraging Pre-trained Language Models for Key Point Matching EMNLP 2021 TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restyling ACL 2021 The Impact of Positional Encodings on Multilingual Compression EMNLP 2021 The Language Model Understood the Prompt was Ambiguous: Probing Syntactic Uncertainty Through Generation EMNLP 2021 Towards Table-to-Text Generation with Numerical Reasoning ACL 2021 UnitedQA: A Hybrid Approach for Open Domain Question Answering ACL 2021 What Context Features Can Transformer Language Models Use? ACL 2021 What’s in the Box? An Analysis of Undesirable Content in the Common Crawl Corpus ACL 2021 When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute EMNLP 2021 Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning NeurIPS 2021 You should evaluate your language model on marginal likelihood over tokenisations EMNLP 2021 Adapting Language Models for Non-Parallel Author-Stylized Rewriting AAAI 2020 Adaptive Compression of Word Embeddings ACL 2020 Alternating Language Modeling for Cross-Lingual Pre-Training AAAI 2020 A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages ACL 2020 Are Pre-trained Language Models Aware of Phrases? Simple but Strong Baselines for Grammar Induction ICLR 2020 Are we Estimating or Guesstimating Translation Quality? ACL 2020