conftrace_

benchmark evaluation

1,616 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (705) multimodal learning (131) vision-language model (124) question answering (117) multimodal large language model (111) language model (108) visual question answering (64) evaluation benchmark (57) code generation (55) benchmark dataset (52)

Papers

Humanity’s Last Code Exam: Can Advanced LLMs Conquer Human’s Hardest Code Competition? EMNLP 2025 IberoBench: A Benchmark for LLM Evaluation in Iberian Languages COLING 2025 ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editing ICCV 2025 IDEA-Bench: How Far are Generative Models from Professional Designing? CVPR 2025 Identifying Open Challenges in Language Identification ACL 2025 IdentifyMe: A Challenging Long-Context Mention Resolution Benchmark for LLMs NAACL 2025 IFIR: A Comprehensive Benchmark for Evaluating Instruction-Following in Expert-Domain Information Retrieval NAACL 2025 Improving Model Evaluation using SMART Filtering of Benchmark Datasets NAACL 2025 In Benchmarks We Trust ... Or Not? EMNLP 2025 INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge ICLR 2025 Incorporating Diverse Perspectives in Cultural Alignment: Survey of Evaluation Benchmarks Through A Three-Dimensional Framework EMNLP 2025 InductionBench: LLMs Fail in the Simplest Complexity Class ACL 2025 Information Density Principle for MLLM Benchmarks ICCV 2025 Insight Over Sight: Exploring the Vision-Knowledge Conflicts in Multimodal LLMs ACL 2025 Instance-level Randomization: Toward More Stable LLM Evaluations EMNLP 2025 InstructPart: Task-Oriented Part Segmentation with Instruction Reasoning ACL 2025 Interactive Evaluation for Medical LLMs via Task-oriented Dialogue System COLING 2025 INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent ACL 2025 Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness NAACL 2025 Is Your Model Really A Good Math Reasoner? Evaluating Mathematical Reasoning with Checklist ICLR 2025 iVISPAR — An Interactive Visual-Spatial Reasoning Benchmark for VLMs EMNLP 2025 Jigsaw-Puzzles: From Seeing to Understanding to Reasoning in Vision-Language Models EMNLP 2025 JMedBench: A Benchmark for Evaluating Japanese Biomedical Large Language Models COLING 2025 JudgeBench: A Benchmark for Evaluating LLM-Based Judges ICLR 2025 JuStRank: Benchmarking LLM Judges for System Ranking ACL 2025