conftrace_

evaluation benchmark

257 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) question answering (2963) language model (4599) model evaluation (445) language model evaluation (227) instruction following (396) machine translation (2499) multimodal learning (4645) multilingual nlp (1426)

Papers

CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation ACL 2025
ODE: Open-Set Evaluation of Hallucinations in Multimodal Large Language Models CVPR 2025
MaXIFE: Multilingual and Cross-lingual Instruction Following Evaluation ACL 2025
ETHIC: Evaluating Large Language Models on Long-Context Tasks with High Information Coverage NAACL 2025
Is Your LLM Outdated? A Deep Look at Temporal Generalization NAACL 2025
LongLeader: A Comprehensive Leaderboard for Large Language Models in Long-context Scenarios NAACL 2025
MedEthicEval: Evaluating Large Language Models Based on Chinese Medical Ethics NAACL 2025
Cracking the Code: Multi-domain LLM Evaluation on Real-World Professional Exams in Indonesia NAACL 2025
CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments NAACL 2025
CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models NAACL 2025
On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation ACL 2024
Latxa: An Open Language Model and Evaluation Suite for Basque ACL 2024
Open Ko-LLM Leaderboard: Evaluating Large Language Models in Korean with Ko-H5 Benchmark ACL 2024
EmoBench: Evaluating the Emotional Intelligence of Large Language Models ACL 2024
AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents NIPS 2024
SUGARCREPE++ Dataset: Vision-Language Model Sensitivity to Semantic and Lexical Alterations NIPS 2024
Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization NAACL 2024
Towards the TopMost: A Topic Modeling System Toolkit ACL 2024
OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI NIPS 2024
LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models NIPS 2024
BotChat: Evaluating LLMs’ Capabilities of Having Multi-Turn Dialogues NAACL 2024
Investigating Data Contamination in Modern Benchmarks for Large Language Models NAACL 2024
ZSC-Eval: An Evaluation Toolkit and Benchmark for Multi-agent Zero-shot Coordination NIPS 2024
FREB-TQA: A Fine-Grained Robustness Evaluation Benchmark for Table Question Answering NAACL 2024
S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Model NAACL 2024