conftrace_

evaluation framework

138 papers

Explore in graph

Co-occurring keywords

large language model (13587) language model (4599) text generation (2913) evaluation metric (573) human evaluation (379) retrieval-augmented generation (1592) dialogue system (1667) model evaluation (445) question answering (2963) benchmark evaluation (1556)

Papers

Unanswerability Evaluation for Retrieval Augmented Generation ACL 2025
A Unified Agentic Framework for Evaluating Conditional Image Generation ACL 2025
Think Like a Person Before Responding: A Multi-Faceted Evaluation of Persona-Guided LLMs for Countering Hate Speech. ACL 2025
Toward Human-Centered Readability Evaluation EMNLP 2025
Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs EMNLP 2025
PatentScore: Multi-dimensional Evaluation of LLM-Generated Patent Claims EMNLP 2025
MCPEval: Automatic MCP-based Deep Evaluation for AI Agent Models EMNLP 2025
Found in Translation: Measuring Multilingual LLM Consistency as Simple as Translate then Evaluate AACL 2025
FarSense: A Comprehensive Commonsense Benchmark and Evaluation Framework for the Farsi Language AACL 2025
BookAsSumQA: An Evaluation Framework for Aspect-Based Book Summarization via Question Answering AACL 2025
Between the Drafts: An Evaluation Framework for Identifying Quality Improvement and Stylistic Differences in Scientific Texts AACL 2025
SPHERE: An Evaluation Card for Human-AI Systems ACL 2025
Evaluating Input Feature Explanations through a Unified Diagnostic Evaluation Framework NAACL 2025
ZeroSumEval: An Extensible Framework For Scaling LLM Evaluation with Inter-Model Competition ACL 2025
PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Action NIPS 2024
ConSiDERS-The-Human Evaluation Framework: Rethinking Human Evaluation for Generative Large Language Models ACL 2024
ProxyQA: An Alternative Framework for Evaluating Long-Form Text Generation with Large Language Models ACL 2024
HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition ACL 2024
PSST: A Benchmark for Evaluation-driven Text Public-Speaking Style Transfer EMNLP 2024
Evalverse: Unified and Accessible Library for Large Language Model Evaluation EMNLP 2024
FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models EMNLP 2024
Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs EMNLP 2024
Exploring Precision and Recall to assess the quality and diversity of LLMs ACL 2024
Extrinsic Evaluation of Cultural Competence in Large Language Models EMNLP 2024
SPOR: A Comprehensive and Practical Evaluation Method for Compositional Generalization in Data-to-Text Generation ACL 2024