Language Modeling

BabyLM Challenge: Experimenting with Self-Distillation and Reverse-Distillation for Language Model Pre-Training on Constrained Datasets CoNLL 2024 BabyLM Challenge: Exploring the effect of variation sets on language model training efficiency CoNLL 2024 BeanCounter: A low-toxicity, large-scale, and open dataset of business-oriented text NeurIPS 2024 Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations ACL 2024 Benchmarking LLaMA-3 on Arabic Language Generation Tasks ACL 2024 BERTs are Generative In-Context Learners NeurIPS 2024 BERTtime Stories: Investigating the Role of Synthetic Story Data in Language Pre-training CoNLL 2024 Better & Faster Large Language Models via Multi-token Prediction ICML 2024 Beyond Traditional Benchmarks: Analyzing Behaviors of Open LLMs on Data-to-Text Generation ACL 2024 Block Transformer: Global-to-Local Language Modeling for Fast Inference NeurIPS 2024 BLSP-Emo: Towards Empathetic Large Speech-Language Models EMNLP 2024 BoNBoN Alignment for Large Language Models and the Sweetness of Best-of-n Sampling NeurIPS 2024 BordIRlines: A Dataset for Evaluating Cross-lingual Retrieval Augmented Generation EMNLP 2024 BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training EMNLP 2024 BRAIn: Bayesian Reward-conditioned Amortized Inference for natural language generation from feedback ICML 2024 Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observations EMNLP 2024 Break the Sequential Dependency of LLM Inference Using Lookahead Decoding ICML 2024 BSharedRAG: Backbone Shared Retrieval-Augmented Generation for the E-commerce Domain EMNLP 2024 Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling ICML 2024 Calc-CMU at SemEval-2024 Task 7: Pre-Calc - Learning to Use the Calculator Improves Numeracy in Language Models SemEval 2024 CAMERA³: An Evaluation Dataset for Controllable Ad Text Generation in Japanese COLING 2024 Can Language Models Induce Grammatical Knowledge from Indirect Evidence? EMNLP 2024 Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales? NeurIPS 2024 Can Machines Resonate with Humans? Evaluating the Emotional and Empathic Comprehension of LMs EMNLP 2024 Can Transformers Learn n-gram Language Models? EMNLP 2024