Language Models

Once Read is Enough: Domain-specific Pretraining-free Language Models with Cluster-guided Sparse Experts for Long-tail Domain Knowledge NeurIPS 2024 On the Effect of (Near) Duplicate Subwords in Language Modelling ACL 2024 On the Reliability of Psychological Scales on Large Language Models EMNLP 2024 On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning ACL 2024 Paloma: A Benchmark for Evaluating Language Model Fit NeurIPS 2024 Paraphrase Types Elicit Prompt Engineering Capabilities EMNLP 2024 Preparing Lessons for Progressive Training on Language Models AAAI 2024 ProLex: A Benchmark for Language Proficiency-oriented Lexical Substitution ACL 2024 Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models EMNLP 2024 Quantifying Contamination in Evaluating Code Generation Capabilities of Language Models ACL 2024 ReactXT: Understanding Molecular “Reaction-ship” via Reaction-Contextualized Molecule-Text Pretraining ACL 2024 Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling ACL 2024 Retrieval-Augmented Knowledge Integration into Language Models: A Survey ACL 2024 Retrieve, Generate, Evaluate: A Case Study for Medical Paraphrases Generation with Small Language Models ACL 2024 Scaling Laws for Linear Complexity Language Models EMNLP 2024 Scaling Parameter-Constrained Language Models with Quality Data EMNLP 2024 SEED: Semantic Knowledge Transfer for Language Model Adaptation to Materials Science EMNLP 2024 SSS: Editing Factual Knowledge in Language Models towards Semantic Sparse Space ACL 2024 Stable Language Model Pre-training by Reducing Embedding Variability EMNLP 2024 SumTablets: A Transliteration Dataset of Sumerian Tablets ACL 2024 Surprise! Uniform Information Density Isn’t the Whole Story: Predicting Surprisal Contours in Long-form Discourse EMNLP 2024 Target-Aware Language Modeling via Granular Data Sampling EMNLP 2024 Tending Towards Stability: Convergence Challenges in Small Language Models EMNLP 2024 The effects of distance on NPI illusive effects in BERT EMNLP 2024 Towards a Transformer-Based Reverse Dictionary Model for Quality Estimation of Definitions (Student Abstract) AAAI 2024