Language Modeling

Self-Evolution Learning for Discriminative Language Model Pretraining ACL 2023 Semantic Decomposition of Question and SQL for Text-to-SQL Parsing EMNLP 2023 Semantic Segmentation with Bidirectional Language Models Improves Long-form ASR Interspeech 2023 Sequential Integrated Gradients: a simple but effective method for explaining language models ACL 2023 SERENGETI: Massively Multilingual Language Models for Africa ACL 2023 Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study EMNLP 2023 Shielded Representations: Protecting Sensitive Attributes Through Iterative Gradient-Based Projection ACL 2023 Should you marginalize over possible tokenizations? ACL 2023 SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval ACL 2023 Simple and Effective Multi-Token Completion from Masked Language Models EACL 2023 Simple Hardware-Efficient PCFGs with Independent Left and Right Productions EMNLP 2023 Sparse Universal Transformer EMNLP 2023 Spelling convention sensitivity in neural language models EACL 2023 Statistically Profiling Biases in Natural Language Reasoning Datasets and Models EMNLP 2023 SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF EMNLP 2023 STOA-VLP: Spatial-Temporal Modeling of Object and Action for Video-Language Pre-training AAAI 2023 Sudowoodo: A Chinese Lyric Imitation System with Source Lyrics EMNLP 2023 Surface-Based Retrieval Reduces Perplexity of Retrieval-Augmented Language Models ACL 2023 Symbol tuning improves in-context learning in language models EMNLP 2023 Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Models ICML 2023 T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics EMNLP 2023 TADA : Task Agnostic Dialect Adapters for English ACL 2023 Test-time Augmentation for Factual Probing EMNLP 2023 Text Rendering Strategies for Pixel Language Models EMNLP 2023 That was the last straw, we need more: Are Translation Systems Sensitive to Disambiguating Context? EMNLP 2023