Skip to content
conftrace_

llm evaluator

10 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (5) human alignment (2) pairwise evaluation (2) evaluator consistency (2) human preference alignment (2) evaluation framework (2) hierarchical criteria decomposition (1) attribute pruning (1) text evaluation (1) many-shot learning (1)

Papers

Can Many-Shot In-Context Learning Help LLMs as Evaluators? A Preliminary Empirical Study COLING 2025 Evaluating the Consistency of LLM Evaluators COLING 2025 GEAR: A Scalable and Interpretable Evaluation Framework for RAG-Based Car Assistant Systems EMNLP 2025 Is my Meeting Summary Good? Estimating Quality with a Multi-LLM Evaluator COLING 2025 The Comparative Trap: Pairwise Comparisons Amplifies Biased Preferences of LLM Evaluators EMNLP 2025 BatchEval: Towards Human-like Text Evaluation ACL 2024 Bayesian Calibration of Win Rate Estimation with LLM Evaluators EMNLP 2024 Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments EMNLP 2024 HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition ACL 2024 Split and Merge: Aligning Position Biases in LLM-based Evaluators EMNLP 2024