Language Modeling

What Makes My Model Perplexed? A Linguistic Investigation on Neural Language Models Perplexity NAACL 2021 When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute EMNLP 2021 When does Further Pre-training MLM Help? An Empirical Study on Task-Oriented Dialog Pre-training EMNLP 2021 When does text prediction benefit from additional context? An exploration of contextual signals for chat and email messages NAACL 2021 When Do You Need Billions of Words of Pretraining Data? ACL 2021 WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach EMNLP 2021 You should evaluate your language model on marginal likelihood over tokenisations EMNLP 2021 ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract Meaning SemEval 2021 A 43 Language Multilingual Punctuation Prediction Neural Network Model Interspeech 2020 A BERT-based Dual Embedding Model for Chinese Idiom Prediction COLING 2020 Adapting Language Models for Non-Parallel Author-Stylized Rewriting AAAI 2020 Adapting Open Domain Fact Extraction and Verification to COVID-FACT through In-Domain Language Modeling EMNLP 2020 Advancing Seq2seq with Joint Paraphrase Learning EMNLP 2020 A Generative Model for Joint Natural Language Understanding and Generation ACL 2020 Alibaba Submission to the WMT20 Parallel Corpus Filtering Task EMNLP 2020 Alternating Language Modeling for Cross-Lingual Pre-Training AAAI 2020 A Mixture of h - 1 Heads is Better than h Heads ACL 2020 Amobee at SemEval-2020 Task 7: Regularization of Language Model Based Classifiers SemEval 2020 A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages ACL 2020 Analysing Lexical Semantic Change with Contextualised Word Representations ACL 2020 Analysing Word Representation from the Input and Output Embeddings in Neural Network Language Models CoNLL 2020 Analyzing Individual Neurons in Pre-trained Language Models EMNLP 2020 An Analysis of the Utility of Explicit Negative Examples to Improve the Syntactic Abilities of Neural Language Models ACL 2020 An Attentive Recurrent Model for Incremental Prediction of Sentence-final Verbs EMNLP 2020 An Ensemble Method for Producing Word Representations focusing on the Greek Language AACL 2020