Evaluation

Do Contemporary Causal Inference Models Capture Real-World Heterogeneity? Findings from a Large-Scale Benchmark ICLR 2025 Document-Level Text Generation with Minimum Bayes Risk Decoding using Optimal Transport ACL 2025 Does Acceleration Cause Hidden Instability in Vision Language Models? Uncovering Instance-Level Divergence Through a Large-Scale Empirical Study EMNLP 2025 Does Biomedical Training Lead to Better Medical Performance? ACL 2025 Does Context Matter? ContextualJudgeBench for Evaluating LLM-based Judges in Contextual Settings ACL 2025 Does Data Contamination Detection Work (Well) for LLMs? A Survey and Evaluation on Detection Assumptions NAACL 2025 Does Training on Synthetic Data Make Models Less Robust? NAACL 2025 Do Influence Functions Work on Large Language Models? EMNLP 2025 Do Language Models Understand the Cognitive Tasks Given to Them? Investigations with the N-Back Paradigm ACL 2025 Do Large Language Models Align with Core Mental Health Counseling Competencies? NAACL 2025 Do Large Language Models Learn Human-Like Strategic Preferences? ACL 2025 Do LLMs Behave as Claimed? Investigating How LLMs Follow Their Own Claims using Counterfactual Questions EMNLP 2025 Do LLMs Give Psychometrically Plausible Responses in Educational Assessments? ACL 2025 Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometrics NAACL 2025 DOMAINEVAL: An Auto-Constructed Benchmark for Multi-Domain Code Generation AAAI 2025 Domain Regeneration: How well do LLMs match syntactic properties of text domains? ACL 2025 Do not Abstain! Identify and Solve the Uncertainty ACL 2025 Don’t Score too Early! Evaluating Argument Mining Models on Incomplete Essays ACL 2025 Don’t Sweat the Small Stuff: Segment-Level Meta-Evaluation Based on Pairwise Difference Correlation EMNLP 2025 Do RAG Systems Really Suffer From Positional Bias? EMNLP 2025 Do Vendi Scores Converge with Finite Samples? Truncated Vendi Score for Finite-Sample Convergence Guarantees UAI 2025 Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation ACL 2025 Drivel-ology: Challenging LLMs with Interpreting Nonsense with Depth EMNLP 2025 DSGram: Dynamic Weighting Sub-Metrics for Grammatical Error Correction in the Era of Large Language Models AAAI 2025 DUTJBD at SemEval-2025 Task 3: A Range of Approaches for Predicting Hallucination Generation in Models SemEval 2025