conftrace_
← Optimization & Theory
Deep Learning › Optimization & Theory ›

Evaluation

509 papers

Papers per year

1
4
1
9
25
37
41
61
47
130
139
14

Papers

LIFBench: Evaluating the Instruction Following Performance and Stability of Large Language Models in Long-Context Scenarios ACL 2025
SCOP: Evaluating the Comprehension Process of Large Language Models from a Cognitive View ACL 2025
Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agents ACL 2025
LLMs can be easily Confused by Instructional Distractions ACL 2025
AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark ACL 2025
The Invisible Hand: Unveiling Provider Bias in Large Language Models for Code Generation ACL 2025
CogniBench: A Legal-inspired Framework and Dataset for Assessing Cognitive Faithfulness of Large Language Models ACL 2025
Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaboration ACL 2025
CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation ACL 2025
“What do you call a dog that is incontrovertibly true? Dogma”: Testing LLM Generalization through Humor ACL 2025
Towards Harmonized Uncertainty Estimation for Large Language Models ACL 2025
BIG-Bench Extra Hard ACL 2025
InductionBench: LLMs Fail in the Simplest Complexity Class ACL 2025
Benchmarking Long-Context Language Models on Long Code Understanding ACL 2025
A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better Interpretability ACL 2025
Language Model Probabilities are Not Calibrated in Numeric Contexts ACL 2025
FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation ACL 2025
EditInspector: A Benchmark for Evaluation of Text-Guided Image Edits ACL 2025
Reconsidering LLM Uncertainty Estimation Methods in the Wild ACL 2025
Beyond Text Compression: Evaluating Tokenizers Across Scales ACL 2025
Where Are We? Evaluating LLM Performance on African Languages ACL 2025
ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities ACL 2025
WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging ACL 2025
Optimization before Evaluation: Evaluation with Unoptimized Prompts Can be Misleading ACL 2025
Judging the Judges: Can Large Vision-Language Models Fairly Evaluate Chart Comprehension and Reasoning? ACL 2025