Language Modeling

The CRINGE Loss: Learning what language not to model ACL 2023 The Flan Collection: Designing Data and Methods for Effective Instruction Tuning ICML 2023 The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deployment EMNLP 2023 The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications NeurIPS 2023 The language of prompting: What linguistic properties make a prompt successful? EMNLP 2023 The Linearity of the Effect of Surprisal on Reading Times across Languages EMNLP 2023 The Locality and Symmetry of Positional Encodings EMNLP 2023 The NLP Task Effectiveness of Long-Range Transformers EACL 2023 TheoremQA: A Theorem-driven Question Answering Dataset EMNLP 2023 The ROOTS Search Tool: Data Transparency for LLMs ACL 2023 This prompt is measuring <mask>: evaluating bias evaluation in language models ACL 2023 Three Questions Concerning the Use of Large Language Models to Facilitate Mathematics Learning EMNLP 2023 Time-Aware Language Modeling for Historical Text Dating EMNLP 2023 To Burst or Not to Burst: Generating and Quantifying Improbable Text EMNLP 2023 Tokenization and the Noiseless Channel ACL 2023 Tokenization Impacts Multilingual Language Modeling: Assessing Vocabulary Allocation and Overlap Across Languages ACL 2023 Token-wise Decomposition of Autoregressive Language Model Hidden States for Analyzing Model Predictions ACL 2023 Topic-Guided Self-Introduction Generation for Social Media Users ACL 2023 TopWORDS-Poetry: Simultaneous Text Segmentation and Word Discovery for Classical Chinese Poetry via Bayesian Inference EMNLP 2023 Toward Joint Language Modeling for Speech Units and Text EMNLP 2023 Towards Better Evaluation for Formality-Controlled English-Japanese Machine Translation EMNLP 2023 Trade-Offs Between Fairness and Privacy in Language Modeling ACL 2023 Transformer-Based Language Model Surprisal Predicts Human Reading Times Best with About Two Billion Training Tokens EMNLP 2023 Transformer-based Live Update Generation for Soccer Matches from Microblog Posts EMNLP 2023 Transformer Language Models Handle Word Frequency in Prediction Head ACL 2023