conftrace_

judge model

12 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (6) evaluation benchmark (3) model evaluation (3) pairwise comparison (2) llm evaluation (2) instruction following (2) no-consensus task (1) response quality (1) evaluation fairness (1) multimodal generation (1)

Papers

IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation ACL 2026 Mediocrity is the key for LLM as a Judge Anchor Selection ACL 2026 An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4 ACL 2025 Arbiters of Ambivalence: Challenges of using LLMs in No-Consensus tasks ACL 2025 Beyond the Surface: Measuring Self-Preference in LLM Judgments EMNLP 2025 Direct Judgement Preference Optimization EMNLP 2025 Evaluating Judges as Evaluators: The JETTS Benchmark of LLM-as-Judges as Test-Time Scaling Evaluators ICML 2025 Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges ACL 2025 OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation CVPR 2025 Thinking LLMs: General Instruction Following with Thought Generation ICML 2025 xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation ICLR 2025 OffsetBias: Leveraging Debiased Data for Tuning Evaluators EMNLP 2024