Large Language Models

On the differences between BERT and MT encoder spaces and how to address them in translation tasks ACL 2021 On the Language-specificity of Multilingual BERT and the Impact of Fine-tuning EMNLP 2021 On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines ICLR 2021 Prefix-Tuning: Optimizing Continuous Prompts for Generation ACL 2021 Probing Across Time: What Does RoBERTa Know and When? EMNLP 2021 Probing Language Models for Understanding of Temporal Expressions EMNLP 2021 Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning EMNLP 2021 Reconsidering the Past: Optimizing Hidden States in Language Models EMNLP 2021 Rethinking Embedding Coupling in Pre-trained Language Models ICLR 2021 Span Fine-tuning for Pre-trained Language Models EMNLP 2021 Surface Form Competition: Why the Highest Probability Answer Isn’t Always Right EMNLP 2021 Syntax-augmented Multilingual BERT for Cross-lingual Transfer ACL 2021 Syntax-Enhanced Pre-trained Model ACL 2021 Transferring Knowledge from Vision to Language: How to Achieve it and how to Measure it? EMNLP 2021 Transformer protein language models are unsupervised structure learners ICLR 2021 TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generation EMNLP 2021 VECO: Variable and Flexible Cross-lingual Pre-training for Language Understanding and Generation ACL 2021 Vyākarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages EMNLP 2021 “Was it “stated” or was it “claimed”?: How linguistic bias affects generative language models EMNLP 2021 What Context Features Can Transformer Language Models Use? ACL 2021 What’s Hidden in a One-layer Randomly Weighted Transformer? EMNLP 2021 When does Further Pre-training MLM Help? An Empirical Study on Task-Oriented Dialog Pre-training EMNLP 2021 Are Pre-trained Language Models Aware of Phrases? Simple but Strong Baselines for Grammar Induction ICLR 2020 AutoNLU: An On-demand Cloud-based Natural Language Understanding System for Enterprises AACL 2020 BERT Loses Patience: Fast and Robust Inference with Early Exit NeurIPS 2020