conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

Re-Evaluating Evaluation for Multilingual Summarization EMNLP 2024
Evaluating Generative Language Models in Information Extraction as Subjective Question Correction COLING 2024
SpeechAlign: A Framework for Speech Translation Alignment Evaluation COLING 2024
BMX: Boosting Natural Language Generation Metrics with Explainability EACL 2024
Generative Interpretation: Toward Human-Like Evaluation for Educational Question-Answer Pair Generation EACL 2024
On Measuring Context Utilization in Document-Level MT Systems EACL 2024
GenAI Arena: An Open Evaluation Platform for Generative Models NIPS 2024
Neural Multimodal Topic Modeling: A Comprehensive Evaluation COLING 2024
MMTE: Corpus and Metrics for Evaluating Machine Translation Quality of Metaphorical Language EMNLP 2024
Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluations COLING 2024
Systematic Task Exploration with LLMs: A Study in Citation Text Generation ACL 2024
Towards Heterogeneous Long-tailed Learning: Benchmarking, Metrics, and Toolbox NIPS 2024
Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models NIPS 2024
AgentQuest: A Modular Benchmark Framework to Measure Progress and Improve LLM Agents NAACL 2024
Reassessing Evaluation Functions in Algorithmic Recourse: An Empirical Study from a Human-Centered Perspective IJCAI 2024
Image-aware Evaluation of Generated Medical Reports NIPS 2024
Rethinking FID: Towards a Better Evaluation Metric for Image Generation CVPR 2024
Polos: Multimodal Metric Learning from Human Feedback for Image Captioning CVPR 2024
BERGEN: A Benchmarking Library for Retrieval-Augmented Generation EMNLP 2024
Beyond Reference: Evaluating High Quality Translations Better than Human References EMNLP 2024
DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generation ACL 2024
Favi-Score: A Measure for Favoritism in Automated Preference Ratings for Generative AI Evaluation ACL 2024
Pioneering Reliable Assessment in Text-to-Image Knowledge Editing: Leveraging a Fine-Grained Dataset and an Innovative Criterion EMNLP 2024
Is Reference Necessary in the Evaluation of NLG Systems? When and Where? NAACL 2024
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization EMNLP 2023