Skip to content
conftrace_

benchmark evaluation

1,616 papers

Papers

The Art of Saying "Maybe": A Conformal Lens for Uncertainty Benchmarking in VLMs EACL 2026 Thesis Proposal: Multimodal Benchmark for Music Understanding in Large Language Models EACL 2026 Thinking beyond the anthropomorphic paradigm benefits LLM research ACL 2026 TimeMachine-bench: A Benchmark for Evaluating Model Capabilities in Repository-Level Migration Tasks EACL 2026 TIME: Temporal-Sensitive Multi-Dimensional Instruction Tuning and Robust Benchmarking for Video-LLMs AAAI 2026 Tiny Scales, Great Challenges: The Limits of Multimodal LLMs in Scale Recognition ACL 2026 Too Long, Didn’t Model: Decomposing LLM Long Context Understanding With Novels EACL 2026 TTA-Bench: A Comprehensive Benchmark for Evaluating Text-to-Audio Models AAAI 2026 TurkBench: A Benchmark for Evaluating Turkish Large Language Models EACL 2026 UNSC-Bench: Evaluating LLM Diplomatic Role-Playing Through UN Security Council Vote Prediction EACL 2026 UQ-Bench: A Benchmark for Evaluating Multimodal LLMs on Underwater Image Quality Assessment AAAI 2026 VerifyBench: A Systematic Benchmark for Evaluating Reasoning Verifiers Across Domains AAAI 2026 Vinclat: Evaluating Reasoning, Cognition and Culture in One Game EACL 2026 VisRes Bench: On Evaluating the Visual Reasoning Capabilities of VLMs CVPR 2026 VL-RouterBench: A Benchmark for Vision-Language Model Routing CVPR 2026 VP-Bench: A Comprehensive Benchmark for Visual Prompting in Multimodal Large Language Models AAAI 2026 WebNovelBench: Placing LLM Novelists on the Web Novel Distribution EACL 2026 What Are You Doing? A Closer Look at Controllable Human Video Generation CVPR 2026 What’s Missing in Vision-Language Models? Probing Their Struggles with Causal Order Reasoning EACL 2026 What to Ask Next? Probing the Imaginative Reasoning of LLMs with TurtleSoup Puzzles AAAI 2026 When Benchmarks Age: Temporal Misalignment through Large Language Model Factuality Evaluation EACL 2026 When Can We Trust LLMs in Mental Health? Large-Scale Benchmarks for Reliable LLM Evaluation EACL 2026 Which Works Best for Vietnamese? A Practical Study of Information Retrieval Methods across Domains EACL 2026 WiseEdit: Benchmarking Cognition- and Creativity-Informed Image Editing CVPR 2026 {$\tau$}-bench: A Benchmark for \underline{T}ool-\underline{A}gent-\underline{U}ser Interaction in Real-World Domains ICLR 2025