benchmark

MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding ICML 2025 MIB: A Mechanistic Interpretability Benchmark ICML 2025 Minerva: A Programmable Memory Test Benchmark for Language Models ICML 2025 MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency ICML 2025 One Example Shown, Many Concepts Known! Counterexample-Driven Conceptual Reasoning in Mathematical LLMs ICML 2025 On Path to Multimodal Generalist: General-Level and General-Bench ICML 2025 OR-Bench: An Over-Refusal Benchmark for Large Language Models ICML 2025 OV-MER: Towards Open-Vocabulary Multimodal Emotion Recognition ICML 2025 PaperBench: Evaluating AI’s Ability to Replicate AI Research ICML 2025 Pareto-Optimal Fronts for Benchmarking Symbolic Regression Algorithms ICML 2025 Position: Societal Impacts Research Requires Benchmarks for Creative Composition Tasks ICML 2025 Putnam-AXIOM: A Functional & Static Benchmark for Measuring Higher Level Mathematical Reasoning in LLMs ICML 2025 RBench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluation ICML 2025 Reliable and Efficient Amortized Model-based Evaluation ICML 2025 Runtime Analysis of Evolutionary NAS for Multiclass Classification ICML 2025 Sanity Checking Causal Representation Learning on a Simple Real-World System ICML 2025 Synthesizing Software Engineering Data in a Test-Driven Manner ICML 2025 TabFSBench: Tabular Benchmark for Feature Shifts in Open Environments ICML 2025 The Jailbreak Tax: How Useful are Your Jailbreak Outputs? ICML 2025 TS-SNN: Temporal Shift Module for Spiking Neural Networks ICML 2025 UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models ICML 2025 UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interaction ICML 2025 Understanding Complexity in VideoQA via Visual Program Generation ICML 2025 Unifying Unsupervised Graph-Level Anomaly Detection and Out-of-Distribution Detection: A Benchmark ICLR 2025 Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale ICML 2025