conftrace_

llm judge

14 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (4) benchmark dataset (3) benchmark evaluation (3) automatic evaluation (2) model evaluation (2) reference-free aggregation (1) prediction aggregation (1) scientific methodology (1) multilingual dialogue (1) system ranking (1)

Papers

BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks ACL 2026 Don’t Judge Code by Its Cover: Exploring Biases in LLM Judges for Code Evaluation EACL 2026 MEDAL: A Framework for Benchmarking LLMs as Multilingual Open-Domain Dialogue Evaluators EACL 2026 Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries EMNLP 2025 ConQRet: A New Benchmark for Fine-Grained Automatic Evaluation of Retrieval Augmented Computational Argumentation NAACL 2025 Evaluating the Quality of Benchmark Datasets for Low-Resource Languages: A Case Study on Turkish ACL 2025 From Calculation to Adjudication: Examining LLM Judges on Mathematical Reasoning Tasks ACL 2025 FrontierScience Bench: Evaluating AI Research Capabilities in LLMs ACL 2025 Improving Automatic Evaluation of Large Language Models (LLMs) in Biomedical Relation Extraction via LLMs-as-the-Judge ACL 2025 JuStRank: Benchmarking LLM Judges for System Ranking ACL 2025 Safer or Luckier? LLMs as Safety Evaluators Are Not Robust to Artifacts ACL 2025 SkillAggregation: Reference-free LLM-Dependent Aggregation ACL 2025 Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking ICLR 2025 L-Eval: Instituting Standardized Evaluation for Long Context Language Models ACL 2024