conftrace_

pairwise comparison

187 papers

Explore in graph

Also known as

PCOMP PC

Co-occurring keywords

large language model (13587) preference learning (418) rank aggregation (53) bradley-terry-luce model (18) sample complexity (1169) active learning (1301) dueling bandit (57) bradley-terry model (31) regret bound (1926) stochastic transitivity (11)

Papers

Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judge IJCNLP 2025
Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference NAACL 2025
Judging It, Washing It: Scoring and Greenwashing Corporate Climate Disclosures using Large Language Models ACL 2025
Knockout LLM Assessment: Using Large Language Models for Evaluations through Iterative Pairwise Comparisons ACL 2025
(Towards) Scalable Reliable Automated Evaluation with Large Language Models ACL 2025
LCES: Zero-shot Automated Essay Scoring via Pairwise Comparisons Using Large Language Models EMNLP 2025
Direct Judgement Preference Optimization EMNLP 2025
MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria NAACL 2025
ESC-Judge: A Framework for Comparing Emotional Support Conversational Agents EMNLP 2025
Finetuning LLMs for Comparative Assessment Tasks COLING 2025
DUO: Diverse, Uncertain, On-Policy Query Generation and Selection for Reinforcement Learning from Human Feedback AAAI 2025
Confidence and Stability of Global and Pairwise Scores in NLP Evaluation ACL 2025
Are Checklists Really Useful for Automatic Evaluation of Generative Tasks? EMNLP 2025
Efficient LLM Comparative Assessment: A Product of Experts Framework for Pairwise Comparisons EMNLP 2024
Active preference learning for ordering items in- and out-of-sample NIPS 2024
Exploring the Impact of Human Evaluator Group on Chat-Oriented Dialogue Evaluation COLING 2024
A LLM-based Ranking Method for the Evaluation of Automatic Counter-Narrative Generation EMNLP 2024
CritiqueLLM: Towards an Informative Critique Generation Model for Evaluation of Large Language Model Generation ACL 2024
It’s All Relative: Learning Interpretable Models for Scoring Subjective Bias in Documents from Pairwise Comparisons EACL 2024
Mitigating Boundary Ambiguity and Inherent Bias for Text Classification in the Era of Large Language Models ACL 2024
LOGIC-LM++: Multi-Step Refinement for Symbolic Formulations ACL 2024
Metric Distortion with Elicited Pairwise Comparisons IJCAI 2024
Learning Social Welfare Functions NIPS 2024
PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data EMNLP 2024
Eliciting Kemeny Rankings AAAI 2024