conftrace_

evaluation benchmark

257 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) question answering (2963) language model (4599) model evaluation (445) language model evaluation (227) instruction following (396) machine translation (2499) multimodal learning (4645) multilingual nlp (1426)

Papers

MaXIFE: Multilingual and Cross-lingual Instruction Following Evaluation ACL 2025
Trojsten Benchmark: Evaluating LLM Problem-Solving in Slovak STEM Competition Problems EMNLP 2025
Beyond Single-Value Metrics: Evaluating and Enhancing LLM Unlearning with Cognitive Diagnosis ACL 2025
The Mirage of Model Editing: Revisiting Evaluation in the Wild ACL 2025
LIFBench: Evaluating the Instruction Following Performance and Stability of Large Language Models in Long-Context Scenarios ACL 2025
VF-Eval: Evaluating Multimodal LLMs for Generating Feedback on AIGC Videos ACL 2025
HalluLens: LLM Hallucination Benchmark ACL 2025
BIG-Bench Extra Hard ACL 2025
SocialEval: Evaluating Social Intelligence of Large Language Models ACL 2025
RusConText Benchmark: A Russian Language Evaluation Benchmark for Understanding Context ACL 2025
MDBench: A Synthetic Multi-Document Reasoning Benchmark Generated with Knowledge Guidance ACL 2025
Ad-hoc Concept Forming in the Game Codenames as a Means for Evaluating Large Language Models ACL 2025
Cracking the Code: Multi-domain LLM Evaluation on Real-World Professional Exams in Indonesia NAACL 2025
PhysicsEval: Inference-Time Techniques to Improve the Reasoning Proficiency of Large Language Models on Physics Problems IJCNLP 2025
CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments NAACL 2025
Unifying AI Tutor Evaluation: An Evaluation Taxonomy for Pedagogical Ability Assessment of LLM-Powered AI Tutors NAACL 2025
ASAudio: A Survey of Advanced Spatial Audio Research AACL 2025
LOTUS: A Leaderboard for Detailed Image Captioning from Quality to Societal Bias and User Preferences ACL 2025
Is Your LLM Outdated? A Deep Look at Temporal Generalization NAACL 2025
IFEval-Audio: Benchmarking Instruction-Following Capability in Audio-based Large Language Models AACL 2025
100-LongBench: Are de facto Long-Context Benchmarks Literally Evaluating Long-Context Ability? ACL 2025
Collab-Overcooked: Benchmarking and Evaluating Large Language Models as Collaborative Agents EMNLP 2025
Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs EMNLP 2025
From Understanding to Generation: An Efficient Shortcut for Evaluating Language Models EMNLP 2025
Evaluating the Evaluator: Measuring LLMs’ Adherence to Task Evaluation Instructions AAAI 2025