Language Modeling

Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models EMNLP 2021 Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little EMNLP 2021 MATE: Multi-view Attention for Table Transformer Efficiency EMNLP 2021 Maximal Multiverse Learning for Promoting Cross-Task Generalization of Fine-Tuned Language Models EACL 2021 Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories EMNLP 2021 Mind the Gap: Assessing Temporal Generalization in Neural Language Models NeurIPS 2021 Mitigating Language-Dependent Ethnic Bias in BERT EMNLP 2021 Mitigating Temporal-Drift: A Simple Approach to Keep NER Models Crisp NAACL 2021 Modeling Text using the Continuous Space Topic Model with Pre-Trained Word Embeddings ACL 2021 Mode recovery in neural autoregressive sequence modeling ACL 2021 MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology ACL 2021 Multidomain Pretrained Language Models for Green NLP EACL 2021 Natural Language Processing 4 All (NLP4All): A New Online Platform for Teaching and Learning NLP Concepts NAACL 2021 Natural Language Processing Meets Quantum Physics: A Survey and Categorization EMNLP 2021 Neural Rule-Execution Tracking Machine For Transformer-Based Text Generation NeurIPS 2021 N-LTP: An Open-source Neural Language Technology Platform for Chinese EMNLP 2021 nmT5 - Is parallel data still relevant for pre-training massively multilingual language models? ACL 2021 Noobs at Semeval-2021 Task 4: Masked Language Modeling for abstract answer prediction SemEval 2021 Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids’ Representations EMNLP 2021 Numeracy enhances the Literacy of Language Models EMNLP 2021 Obtaining Better Static Word Embeddings Using Contextual Embedding Models ACL 2021 On Geodesic Distances and Contextual Embedding Compression for Text Classification NAACL 2021 On Language Models for Creoles CoNLL 2021 On Randomized Classification Layers and Their Implications in Natural Language Generation NAACL 2021 On the Role of Corpus Ordering in Language Modeling EMNLP 2021