conftrace_

llm evaluation

141 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) evaluation benchmark (257) question answering (2963) language model (4599) prompt engineering (1135) hallucination detection (530) text generation (2913) evaluation metric (573) fairness evaluation (118)

Papers

MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems NAACL 2025
LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMs NAACL 2025
How well do LLMs reason over tabular data, really? ACL 2025
Measuring Bias or Measuring the Task: Understanding the Brittle Nature of LLM Gender Biases EMNLP 2025
Characterizing Positional Bias in Large Language Models: A Multi-Model Evaluation of Prompt Order Effects EMNLP 2025
Do LLMs Align Human Values Regarding Social Biases? Judging and Explaining Social Biases with LLMs EMNLP 2025
The Progress Illusion: Revisiting meta-evaluation standards of LLM evaluators EMNLP 2025
Beyond Pointwise Scores: Decomposed Criteria-Based Evaluation of LLM Responses EMNLP 2025
Evaluation Sheet for Deep Research: A Use Case for Academic Survey Writing EMNLP 2025
Nuance Matters: Probing Epistemic Consistency in Causal Reasoning AAAI 2025
HomeBench: Evaluating LLMs in Smart Homes with Valid and Invalid Instructions Across Single and Multiple Devices ACL 2025
Evaluating Personalized Tool-Augmented LLMs from the Perspectives of Personalization and Proactivity ACL 2025
Ranking Unraveled: Recipes for LLM Rankings in Head-to-Head AI Combat ACL 2025
HammerBench: Fine-Grained Function-Calling Evaluation in Real Mobile Assistant Scenarios ACL 2025
Veracity Bias and Beyond: Uncovering LLMs’ Hidden Beliefs in Problem-Solving Reasoning ACL 2025
OpenHuEval: Evaluating Large Language Model on Hungarian Specifics ACL 2025
AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledge ACL 2025
TN-Eval: Rubric and Evaluation Protocols for Measuring the Quality of Behavioral Therapy Notes ACL 2025
Algorithmic Fidelity of Large Language Models in Generating Synthetic German Public Opinions: A Case Study ACL 2025
YESciEval: Robust LLM-as-a-Judge for Scientific Question Answering ACL 2025
PlanningArena: A Modular Benchmark for Multidimensional Evaluation of Planning and Tool Learning ACL 2025
LogicGame: Benchmarking Rule-Based Reasoning Abilities of Large Language Models ACL 2025
Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models ACL 2025
REPA: Russian Error Types Annotation for Evaluating Text Generation and Judgment Capabilities ACL 2025
Fine-Tune on the Format: First Improving Multiple-Choice Evaluation for Intermediate LLM Checkpoints ACL 2025