conftrace_

llm evaluation

141 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) evaluation benchmark (257) question answering (2963) language model (4599) prompt engineering (1135) hallucination detection (530) text generation (2913) evaluation metric (573) fairness evaluation (118)

Papers

Do LLMs Behave as Claimed? Investigating How LLMs Follow Their Own Claims using Counterfactual Questions EMNLP 2025
Model Consistency as a Cheap yet Predictive Proxy for LLM Elo Scores EMNLP 2025
Can LLMs Narrate Tabular Data? An Evaluation Framework for Natural Language Representations of Text-to-SQL System Outputs EMNLP 2025
Automatic Multiple-Choice Question Generation and Evaluation Systems Based on LLM: A Study Case With University Resolutions COLING 2025
MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems NAACL 2025
Transparent Reference-free Automated Evaluation of Open-Ended User Survey Responses EMNLP 2025
Measuring Bias or Measuring the Task: Understanding the Brittle Nature of LLM Gender Biases EMNLP 2025
Human and LLM-Based Resume Matching: An Observational Study NAACL 2025
Drivel-ology: Challenging LLMs with Interpreting Nonsense with Depth EMNLP 2025
Can External Validation Tools Improve Annotation Quality for LLM-as-a-Judge? ACL 2025
UZH at SemEval-2025 Task 3: Token-Level Self-Consistency for Hallucination Detection ACL 2025
FLEX: A Benchmark for Evaluating Robustness of Fairness in Large Language Models NAACL 2025
Graders Should Cheat: Privileged Information Enables Expert-Level Automated Evaluations EMNLP 2025
so much depends / upon / a whitespace: Why Whitespace Matters for Poets and LLMs EMNLP 2025
AIRepr: An Analyst-Inspector Framework for Evaluating Reproducibility of LLMs in Data Science EMNLP 2025
Can You Trick the Grader? Adversarial Persuasion of LLM Judges EMNLP 2025
Hallucination Detection in Structured Query Generation via LLM Self-Debating EMNLP 2025
Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM Responses EMNLP 2025
Judging with Many Minds: Do More Perspectives Mean Less Prejudice? On Bias Amplification and Resistance in Multi-Agent Based LLM-as-Judge EMNLP 2025
The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmas EMNLP 2025
Fingerprinting LLMs through Survey Item Factor Correlation: A Case Study on Humor Style Questionnaire EMNLP 2025
Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values? EMNLP 2025
Towards Optimal Evaluation Efficiency for Large Language Models EMNLP 2025
EmoAgent: Assessing and Safeguarding Human-AI Interaction for Mental Health Safety EMNLP 2025
Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges ACL 2025