Skip to content
conftrace_

benchmark evaluation

1,616 papers

Papers

CS-Bench: A Comprehensive Benchmark for Large Language Models towards Computer Science Mastery ICLR 2025 CULEMO: Cultural Lenses on Emotion - Benchmarking LLMs for Cross-Cultural Emotion Understanding ACL 2025 CulturalFrames: Assessing Cultural Expectation Alignment in Text-to-Image Models and Evaluation Metrics EMNLP 2025 Current Semantic-change Quantification Methods Struggle with Discovery in the Wild EMNLP 2025 CVE-Bench: Benchmarking LLM-based Software Engineering Agent’s Ability to Repair Real-World CVE Vulnerabilities NAACL 2025 Data Laundering: Artificially Boosting Benchmark Results through Knowledge Distillation ACL 2025 DateLogicQA: Benchmarking Temporal Biases in Large Language Models NAACL 2025 DCR: Quantifying Data Contamination in LLMs Evaluation EMNLP 2025 Deep Associations, High Creativity: A Simple yet Effective Metric for Evaluating Large Language Models EMNLP 2025 DependEval: Benchmarking LLMs for Repository Dependency Understanding ACL 2025 Deriving Strategic Market Insights with Large Language Models: A Benchmark for Forward Counterfactual Generation EMNLP 2025 DHP Benchmark: Are LLMs Good NLG Evaluators? NAACL 2025 DI-BENCH: Benchmarking Large Language Models on Dependency Inference with Testable Repositories at Scale ACL 2025 DICE-BENCH: Evaluating the Tool-Use Capabilities of Large Language Models in Multi-Round, Multi-Party Dialogues ACL 2025 Diffusion Models Through a Global Lens: Are They Culturally Inclusive? ACL 2025 Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs ACL 2025 Distinguishing fair from unfair compositional generalization tasks EMNLP 2025 DivLogicEval: A Framework for Benchmarking Logical Reasoning Evaluation in Large Language Models EMNLP 2025 DMT-RoleBench: A Dynamic Multi-Turn Dialogue Based Benchmark for Role-Playing Evaluation of Large Language Model and Agent AAAI 2025 DnA-Eval: Enhancing Large Language Model Evaluation through Decomposition and Aggregation COLING 2025 DocBench: A Benchmark for Evaluating LLM-based Document Reading Systems NAACL 2025 Do Contemporary Causal Inference Models Capture Real-World Heterogeneity? Findings from a Large-Scale Benchmark ICLR 2025 Does Data Contamination Detection Work (Well) for LLMs? A Survey and Evaluation on Detection Assumptions NAACL 2025 Does Spatial Cognition Emerge in Frontier Models? ICLR 2025 Do Large Language Models excel in Complex Logical Reasoning with Formal Language? EMNLP 2025