conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

CA*: Addressing Evaluation Pitfalls in Computation-Aware Latency for Simultaneous Speech Translation NAACL 2025
AnaScore: Understanding Semantic Parallelism in Proportional Analogies NAACL 2025
Eval3D: Interpretable and Fine-grained Evaluation for 3D Generation CVPR 2025
RAGEval: Scenario Specific RAG Evaluation Dataset Generation Framework ACL 2025
Advocating Character Error Rate for Multilingual ASR Evaluation NAACL 2025
Reliability of Topic Modeling NAACL 2025
Trade-offs in Image Generation: How Do Different Dimensions Interact? ICCV 2025
CAMIEval: Enhancing NLG Evaluation through Multidimensional Comparative Instruction-Following Analysis NAACL 2025
BEMEAE: Moving Beyond Exact Span Match for Event Argument Extraction NAACL 2025
CRScore: Grounding Automated Evaluation of Code Review Comments in Code Claims and Smells NAACL 2025
Lost in Transcription, Found in Distribution Shift: Demystifying Hallucination in Speech Foundation Models ACL 2025
GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems EMNLP 2025
FLEX: Expert-level False-Less EXecution Metric for Text-to-SQL Benchmark NAACL 2025
LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMs NAACL 2025
CLEME2.0: Towards Interpretable Evaluation by Disentangling Edits for Grammatical Error Correction ACL 2025
Paraphrase Generation Evaluation Powered by an LLM: A Semantic Metric, Not a Lexical One COLING 2025
Meaningful Pose-Based Sign Language Evaluation EMNLP 2025
EXPERT: An Explainable Image Captioning Evaluation Metric with Structured Explanations ACL 2025
A Unified Agentic Framework for Evaluating Conditional Image Generation ACL 2025
DSGram: Dynamic Weighting Sub-Metrics for Grammatical Error Correction in the Era of Large Language Models AAAI 2025
Quantifying the Influence of Evaluation Aspects on Long-Form Response Assessment COLING 2025
RefVNLI: Towards Scalable Evaluation of Subject-driven Text-to-image Generation EMNLP 2025
RAP: A Metric for Balancing Repetition and Performance in Open-Source Large Language Models NAACL 2025
What Did I Do Wrong? Quantifying LLMs’ Sensitivity and Consistency to Prompt Engineering NAACL 2025
Rethinking Prompt-based Debiasing in Large Language Model ACL 2025