Language Modeling

Shallow Fusion of Weighted Finite-State Transducer and Language Model for Text Normalization Interspeech 2022 Signal in Noise: Exploring Meaning Encoded in Random Character Sequences with Character-Aware Language Models ACL 2022 Simple Local Attentions Remain Competitive for Long-Context Tasks NAACL 2022 Sketching as a Tool for Understanding and Accelerating Self-attention for Long Sequences NAACL 2022 Snoopy: An Online Interface for Exploring the Effect of Pretraining Term Frequencies on Few-Shot LM Performance EMNLP 2022 Socially Aware Bias Measurements for Hindi Language Representations NAACL 2022 SocioProbe: What, When, and Where Language Models Learn about Sociodemographics EMNLP 2022 Softmax Bottleneck Makes Language Models Unable to Represent Multi-mode Word Distributions ACL 2022 Sort by Structure: Language Model Ranking as Dependency Probing NAACL 2022 SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation EMNLP 2022 Sparks: Inspiration for Science Writing using Language Models ACL 2022 Sparse Attention with Learning to Hash ICLR 2022 SRL4E – Semantic Role Labeling for Emotions: A Unified Evaluation Framework ACL 2022 StableMoE: Stable Routing Strategy for Mixture of Experts ACL 2022 Subword Segmental Language Modelling for Nguni Languages EMNLP 2022 SwahBERT: Language Model of Swahili NAACL 2022 TempoWiC: An Evaluation Benchmark for Detecting Meaning Shift in Social Media COLING 2022 Testing Large Language Models on Compositionality and Inference with Phrase-Level Adjective-Noun Entailment COLING 2022 The better your Syntax, the better your Semantics? Probing Pretrained Language Models for the English Comparative Correlative EMNLP 2022 The Devil in Linear Transformer EMNLP 2022 The Effects of Corpus Choice and Morphosyntax on Multilingual Space Induction EMNLP 2022 The Grammar-Learning Trajectories of Neural Language Models ACL 2022 Theory-Grounded Measurement of U.S. Social Stereotypes in English Language Models NAACL 2022 TimeLMs: Diachronic Language Models from Twitter ACL 2022 Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models EMNLP 2022