conftrace_

model ranking

25 papers

Explore in graph

Co-occurring keywords

benchmark evaluation (1556) large language model (13587) model evaluation (445) automatic evaluation (225) dataset comparison (8) model comparison (51) compositional generalization (203) language model evaluation (227) transfer learning (5449) global robustness (5)

Papers

Validating Automatic Evaluation of Controllable Counterspeech Generation: Rankings Matter More Than Scores EACL 2026
Ranking Reasoning LLMs under Test-Time Scaling ACL 2026
Towards Acyclic Preference Evaluation of Language Models via Multiple Evaluators AAAI 2026
League of LLMs: A Benchmark-Free Paradigm for Mutual Evaluation of Large Language Models ACL 2026
Confidence and Stability of Global and Pairwise Scores in NLP Evaluation ACL 2025
Are Bias Evaluation Methods Biased ? ACL 2025
Optimization before Evaluation: Evaluation with Unoptimized Prompts Can be Misleading ACL 2025
ReasonerRank: Redefining Language Model Evaluation with Ground-Truth-Free Ranking Frameworks ACL 2025
Arena-lite: Efficient and Reliable Large Language Model Evaluation via Tournament-Based Direct Comparisons EMNLP 2025
GREAT Score: Global Robustness Evaluation of Adversarial Perturbation using Generative Models NIPS 2024
Navigating the Maze of Explainable AI: A Systematic Approach to Evaluating Methods and Metrics NIPS 2024
Examining the robustness of LLM evaluation to the distributional assumptions of benchmarks ACL 2024
Characterizing the Confidence of Large Language Model-Based Automatic Evaluation Metrics EACL 2024
Anchor Points: Benchmarking Models with Much Fewer Examples EACL 2024
Ranking Large Language Models without Ground Truth ACL 2024
MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures NIPS 2024
SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionality NIPS 2023
The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks EMNLP 2023
MixPath: A Unified Approach for One-shot Neural Architecture Search ICCV 2023
The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks CONLL 2023
On the Challenges of Using Black-Box APIs for Toxicity Evaluation in Research EMNLP 2023
Evidence > Intuition: Transferability Estimation for Encoder Selection EMNLP 2022
Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking NIPS 2021
Evaluation Examples are not Equally Informative: How should that change NLP Leaderboards? ACL 2021
Ranking Models in Unlabeled New Environments ICCV 2021