Large Language Models

The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs ACL 2025 The AraGenEval Shared Task on Arabic Authorship Style Transfer and AI Generated Text Detection EMNLP 2025 The Behavior Gap: Evaluating Zero-shot LLM Agents in Complex Task-Oriented Dialogs ACL 2025 The Berkeley Function Calling Leaderboard (BFCL): From Tool Use to Agentic Evaluation of Large Language Models ICML 2025 The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models NAACL 2025 The contribution of LLMs to relation extraction in the economic field COLING 2025 The Devil is in Temporal Token: High Quality Video Reasoning Segmentation CVPR 2025 The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generation CVPR 2025 The discordance between embedded ethics and cultural inference in large language models EMNLP 2025 The Emperor’s New Clothes in Benchmarking? A Rigorous Examination of Mitigation Strategies for LLM Benchmark Data Contamination ICML 2025 The Essence of Contextual Understanding in Theory of Mind: A Study on Question Answering with Story Characters ACL 2025 “The Facts Speak for Themselves”: GPT and Fallacy Classification ACL 2025 The Gaps between Fine Tuning and In-context Learning in Bias Evaluation and Debiasing COLING 2025 The Gemma Sutras: Fine-Tuning Gemma 3 for Sanskrit Sandhi Splitting EMNLP 2025 The Geometry of Categorical and Hierarchical Concepts in Large Language Models ICLR 2025 The Good, the Bad, and the Debatable: A Survey on the Impacts of Data for In-Context Learning EMNLP 2025 The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism NAACL 2025 The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs EMNLP 2025 The Illusion of Role Separation: Hidden Shortcuts in LLM Role Learning (and How to Fix Them) ICML 2025 The Impact of Domain-Specific Terminology on Machine Translation for Finance in European Languages NAACL 2025 The Impact of Language Mixing on Bilingual LLM Reasoning EMNLP 2025 The Impact of Large Language Models in Academia: from Writing to Speaking ACL 2025 The Invalsi Benchmarks: measuring the Linguistic and Mathematical understanding of Large Language Models in Italian COLING 2025 The Inverse Scaling Effect of Pre-Trained Language Model Surprisal Is Not Due to Data Leakage ACL 2025 The Invisible Hand: Unveiling Provider Bias in Large Language Models for Code Generation ACL 2025