Language Modeling

LogicNMR: Probing the Non-monotonic Reasoning Ability of Pre-trained Language Models EMNLP 2022 LogiTorch: A PyTorch-based library for logical reasoning on natural language EMNLP 2022 Long Text Generation with Topic-aware Discrete Latent Variable Model EMNLP 2022 Low-Rank Softmax Can Have Unargmaxable Classes in Theory but Rarely in Practice ACL 2022 MANTa: Efficient Gradient-Based Tokenization for End-to-End Robust Language Modeling EMNLP 2022 Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token EMNLP 2022 Materialized Knowledge Bases from Commonsense Transformers ACL 2022 MaxMatch-Dropout: Subword Regularization for WordPiece COLING 2022 MCP: Self-supervised Pre-training for Personalized Chatbots with Multi-level Contrastive Sampling EMNLP 2022 Measuring Fairness with Biased Rulers: A Comparative Study on Bias Metrics for Pre-trained Language Models NAACL 2022 Measuring the Impact of (Psycho-)Linguistic and Readability Features and Their Spill Over Effects on the Prediction of Eye Movement Patterns ACL 2022 Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models NeurIPS 2022 MetaICL: Learning to Learn In Context NAACL 2022 Meta-Learning Fast Weight Language Models EMNLP 2022 Meta Learning for Natural Language Processing: A Survey NAACL 2022 Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages ACL 2022 Mind Your Bias: A Critical Review of Bias Detection Methods for Contextual Language Models EMNLP 2022 Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal ACL 2022 Modal Dependency Parsing via Language Model Priming NAACL 2022 Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens NAACL 2022 MonoByte: A Pool of Monolingual Byte-level Language Models COLING 2022 Most Language Models can be Poets too: An AI Writing Assistant and Constrained Text Generation Studio COLING 2022 Multilingual Syntax-aware Language Modeling through Dependency Tree Conversion ACL 2022 Multilingual unsupervised sequence segmentation transfers to extremely low-resource languages ACL 2022 Multi Resolution Analysis (MRA) for Approximate Self-Attention ICML 2022