Language Models

Can Transformers Learn n-gram Language Models? EMNLP 2024 Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment ACL 2024 CASE: Efficient Curricular Data Pre-training for Building Assistive Psychology Expert Models EMNLP 2024 CheckersGPT: Learning World Models through Language Modeling ACL 2024 Cheetah: Natural Language Generation for 517 African Languages ACL 2024 COKE: A Cognitive Knowledge Graph for Machine Theory of Mind ACL 2024 Comparing Pre-trained Human Language Models: Is it Better with Human Context as Groups, Individual Traits, or Both? ACL 2024 Concept Space Alignment in Multilingual LLMs EMNLP 2024 CONTESTS: a Framework for Consistency Testing of Span Probabilities in Language Models EMNLP 2024 Controlled Text Generation for Black-box Language Models via Score-based Progressive Editor ACL 2024 Co-occurrence is not Factual Association in Language Models NeurIPS 2024 DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA NeurIPS 2024 Data, Data Everywhere: A Guide for Pretraining Dataset Construction EMNLP 2024 Demystifying Verbatim Memorization in Large Language Models EMNLP 2024 DePLM: Denoising Protein Language Models for Property Optimization NeurIPS 2024 Design Proteins Using Large Language Models: Enhancements and Comparative Analyses ACL 2024 Dialogue for Prompting: A Policy-Gradient-Based Discrete Prompt Generation for Few-Shot Learning AAAI 2024 Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research ACL 2024 Emergent Word Order Universals from Cognitively-Motivated Language Models ACL 2024 Evaluating Extrapolation Ability of Large Language Model in Chemical Domain ACL 2024 Evaluating n-Gram Novelty of Language Models Using Rusty-DAWG EMNLP 2024 Experimental Contexts Can Facilitate Robust Semantic Property Inference in Language Models, but Inconsistently EMNLP 2024 Explaining and Improving Contrastive Decoding by Extrapolating the Probabilities of a Huge and Hypothetical LM EMNLP 2024 Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic Reasoning AAAI 2024 FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data EMNLP 2024