Language Modeling

Revisiting Simple Neural Probabilistic Language Models NAACL 2021 Sample-efficient Linguistic Generalizations through Program Synthesis: Experiments with Phonology Problems ACL 2021 Sawtooth Factorial Topic Embeddings Guided Gamma Belief Network ICML 2021 SciXGen: A Scientific Paper Dataset for Context-Aware Text Generation EMNLP 2021 Searching for Efficient Transformers for Language Modeling NeurIPS 2021 Segatron: Segment-Aware Transformer for Language Modeling and Understanding AAAI 2021 Selecting Informative Contexts Improves Language Model Fine-tuning ACL 2021 Self-training with Few-shot Rationalization EMNLP 2021 Semantics of the Unwritten: The Effect of End of Paragraph and Sequence Tokens on Text Generation with GPT2 ACL 2021 SHAPELURN: An Interactive Language Learning Game with Logical Inference ACL 2021 Shortformer: Better Language Modeling using Shorter Inputs ACL 2021 Simpson's Bias in NLP Training AAAI 2021 Sociolectal Analysis of Pretrained Language Models EMNLP 2021 Span Fine-tuning for Pre-trained Language Models EMNLP 2021 Sparse is Enough in Scaling Transformers NeurIPS 2021 Speeding Up Transformer Training By Using Dataset Subsampling - An Exploratory Analysis EMNLP 2021 SPRING Goes Online: End-to-End AMR Parsing and Generation EMNLP 2021 Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you? EMNLP 2021 Structural Guidance for Transformer Language Models ACL 2021 Structural Realization with GGNNs NAACL 2021 Structure-aware Sentence Encoder in Bert-Based Siamese Network ACL 2021 Studying word order through iterative shuffling EMNLP 2021 StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer NAACL 2021 Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models ACL 2021 Teaching NLP with Bracelets and Restaurant Menus: An Interactive Workshop for Italian Students NAACL 2021