Skip to content
conftrace_

benchmark evaluation

1,616 papers

Papers

KazBench-KK: A Cultural-Knowledge Benchmark for Kazakh ACL 2025 KazMMLU: Evaluating Language Models on Kazakh, Russian, and Regional Knowledge of Kazakhstan ACL 2025 Keep Guessing? When Considering Inference Scaling, Mind the Baselines NAACL 2025 KMMLU: Measuring Massive Multitask Language Understanding in Korean NAACL 2025 Ko-LongRAG: A Korean Long-Context RAG Benchmark Built with a Retrieval-Free Approach EMNLP 2025 KRETA: A Benchmark for Korean Reading and Reasoning in Text-Rich VQA Attuned to Diverse Visual Contexts EMNLP 2025 KRISTEVA: Close Reading as a Novel Task for Benchmarking Interpretive Reasoning ACL 2025 LaMP-QA: A Benchmark for Personalized Long-form Question Answering EMNLP 2025 Languages Still Left Behind: Toward a Better Multilingual Machine Translation Benchmark EMNLP 2025 Large Language Model Agents in Finance: A Survey Bridging Research, Practice, and Real-World Deployment EMNLP 2025 Large Language Models Badly Generalize across Option Length, Problem Types, and Irrelevant Noun Replacements EMNLP 2025 Large Language Models for Predictive Analysis: How Far Are They? ACL 2025 LastingBench: Defend Benchmarks Against Knowledge Leakage EMNLP 2025 Law of the Weakest Link: Cross Capabilities of Large Language Models ICLR 2025 LCFO: Long Context and Long Form Output Dataset and Benchmarking ACL 2025 LegalAgentBench: Evaluating LLM Agents in Legal Domain ACL 2025 Leveraging Large Models to Evaluate Novel Content: A Case Study on Advertisement Creativity EMNLP 2025 LeWiDi-2025 at NLPerspectives: Third Edition of the Learning with Disagreements Shared Task EMNLP 2025 Lexical Recall or Logical Reasoning: Probing the Limits of Reasoning Abilities in Large Language Models ACL 2025 LIFBench: Evaluating the Instruction Following Performance and Stability of Large Language Models in Long-Context Scenarios ACL 2025 LIME: Less Is More for MLLM Evaluation ACL 2025 Limited Generalizability in Argument Mining: State-Of-The-Art Models Learn Datasets, Not Arguments ACL 2025 LingGym: How Far Are LLMs from Thinking Like Field Linguists? EMNLP 2025 LiteraryQA: Towards Effective Evaluation of Long-document Narrative QA EMNLP 2025 LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code ICLR 2025