conftrace_

multiple-choice benchmark

5 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (2) frontier ai models (1) predictable evaluations (1) multi-document understanding (1) negative log-likelihood (1) code reasoning (1) probability mass (1) benchmark difficulty (1) event reasoning (1) code understanding (1)

Papers

CrossHOI-Bench: A Unified Benchmark for HOI Evaluation across Vision-Language Models and HOI-Specific Methods CVPR 2026 SemEval-2026 Task 12: Abductive Event Reasoning: Towards Real-World Event Causal Inference for Large Language Models SemEval 2026 CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs ICLR 2025 Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive? ICML 2025 WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging ACL 2025