conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

Quantifying the Influence of Evaluation Aspects on Long-Form Response Assessment COLING 2025
Evaluation Sheet for Deep Research: A Use Case for Academic Survey Writing EMNLP 2025
Evaluating Sequence Labeling on the basis of Information Theory ACL 2025
NRC Systems for the WMT2025-LRSL Shared Task EMNLP 2025
Rethinking Evaluation Metrics for Grammatical Error Correction: Why Use a Different Evaluation Process than Human? ACL 2025
Lost in Transcription, Found in Distribution Shift: Demystifying Hallucination in Speech Foundation Models ACL 2025
TripCraft: A Benchmark for Spatio-Temporally Fine Grained Travel Planning ACL 2025
A Unified Agentic Framework for Evaluating Conditional Image Generation ACL 2025
RAGEval: Scenario Specific RAG Evaluation Dataset Generation Framework ACL 2025
TC-Bench: Benchmarking Temporal Compositionality in Conditional Video Generation ACL 2025
BEMEAE: Moving Beyond Exact Span Match for Event Argument Extraction NAACL 2025
FLEX: Expert-level False-Less EXecution Metric for Text-to-SQL Benchmark NAACL 2025
DSGram: Dynamic Weighting Sub-Metrics for Grammatical Error Correction in the Era of Large Language Models AAAI 2025
Every Component Counts: Rethinking the Measure of Success for Medical Semantic Segmentation in Multi-Instance Segmentation Tasks AAAI 2025
Are Your LLMs Capable of Stable Reasoning? ACL 2025
FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation ACL 2025
ReEvalMed: Rethinking Medical Report Evaluation by Aligning Metrics with Real-World Clinical Judgment EMNLP 2025
CAP: Evaluation of Persuasive and Creative Image Generation ICCV 2025
Beyond N-Grams: Rethinking Evaluation Metrics and Strategies for Multilingual Abstractive Summarization ACL 2025
Image Captioning Evaluation in the Age of Multimodal LLMs: Challenges and Future Perspectives IJCAI 2025
Image Over Text: Transforming Formula Recognition Evaluation with Character Detection Matching CVPR 2025
PatentScore: Multi-dimensional Evaluation of LLM-Generated Patent Claims EMNLP 2025
Findings of the AmericasNLP 2025 Shared Tasks on Machine Translation, Creation of Educational Material, and Translation Metrics for Indigenous Languages of the Americas NAACL 2025
Reliable Evaluation and Benchmarks for Statement Autoformalization EMNLP 2025
Evaluating Evaluation Metrics for Ancient Chinese to English Machine Translation NAACL 2025