conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

CAMIEval: Enhancing NLG Evaluation through Multidimensional Comparative Instruction-Following Analysis NAACL 2025
LRMGS: A Language-Robust Metric for Evaluating Question Answering in Very Low-Resource Indic Languages IJCNLP 2025
CLEV: LLM-Based Evaluation Through Lightweight Efficient Voting for Free-Form Question-Answering IJCNLP 2025
Trade-offs in Image Generation: How Do Different Dimensions Interact? ICCV 2025
Paraphrase Generation Evaluation Powered by an LLM: A Semantic Metric, Not a Lexical One COLING 2025
Multi-Layered Evaluation Using a Fusion of Metrics and LLMs as Judges in Open-Domain Question Answering COLING 2025
ASTRID - An Automated and Scalable TRIaD for the Evaluation of RAG-based Clinical Question Answering Systems ACL 2025
Has Machine Translation Evaluation Achieved Human Parity? The Human Reference and the Limits of Progress ACL 2025
Assessing LLM Reasoning Steps via Principal Knowledge Grounding EMNLP 2025
RadEval: A framework for radiology text evaluation EMNLP 2025
A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better Interpretability ACL 2025
Advocating Character Error Rate for Multilingual ASR Evaluation NAACL 2025
Rethinking Evaluation Metrics for Grammatical Error Correction: Why Use a Different Evaluation Process than Human? ACL 2025
RefVNLI: Towards Scalable Evaluation of Subject-driven Text-to-image Generation EMNLP 2025
Why should only High-Resource-Languages have all the fun? Pivot Based Evaluation in Low Resource Setting COLING 2025
QAEval: Mixture of Evaluators for Question-Answering Task Evaluation ACL 2025
InspectorRAGet: An Introspection Platform for RAG Evaluation NAACL 2025
Beyond statistical significance: Quantifying uncertainty and statistical variability in multilingual and multitask NLP evaluation AACL 2025
ContrastScore: Towards Higher Quality, Less Biased, More Efficient Evaluation Metrics with Contrastive Evaluation IJCNLP 2025
Feeding Two Birds or Favoring One? Adequacy–Fluency Tradeoffs in Evaluation and Meta-Evaluation of Machine Translation EMNLP 2025
Metric Calculating Benchmark: Code-Verifiable Complicate Instruction Following Benchmark for Large Language Models EMNLP 2025
DivLogicEval: A Framework for Benchmarking Logical Reasoning Evaluation in Large Language Models EMNLP 2025
Noise-Aware Evaluation of Object Detectors WACV 2025
GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems EMNLP 2025
PrExMe! Large Scale Prompt Exploration of Open Source LLMs for Machine Translation and Summarization Evaluation EMNLP 2024