conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

Ranking Large Language Models without Ground Truth ACL 2024
Combining Multiple Metrics for Evaluating Retrieval-Augmented Conversations NAACL 2024
Favi-Score: A Measure for Favoritism in Automated Preference Ratings for Generative AI Evaluation ACL 2024
Meta-Evaluation of Sentence Simplification Metrics COLING 2024
SeMaScore: A new evaluation metric for automatic speech recognition tasks INTERSPEECH 2024
A Survey of Learning Criteria Going beyond the Usual Risk (Abstract Reprint) AAAI 2024
POSIX: A Prompt Sensitivity Index For Large Language Models EMNLP 2024
SignBLEU: Automatic Evaluation of Multi-channel Sign Language Translation COLING 2024
AgentQuest: A Modular Benchmark Framework to Measure Progress and Improve LLM Agents NAACL 2024
SciGisPy: a Novel Metric for Biomedical Text Simplification via Gist Inference Score EMNLP 2024
Keyphrase Generation: Lessons from a Reproducibility Study COLING 2024
Unlocking Structure Measuring: Introducing PDD, an Automatic Metric for Positional Discourse Coherence NAACL 2024
Granular Change Accuracy: A More Accurate Performance Metric for Dialogue State Tracking COLING 2024
I Need Help! Evaluating LLM’s Ability to Ask for Users’ Support: A Case Study on Text-to-SQL Generation EMNLP 2024
Beyond Reference: Evaluating High Quality Translations Better than Human References EMNLP 2024
SIERA: An Evaluation Metric for Text Simplification using the Ranking Model and Data Augmentation by Edit Operations COLING 2024
MMTE: Corpus and Metrics for Evaluating Machine Translation Quality of Metaphorical Language EMNLP 2024
Towards Explainable Evaluation Metrics for Machine Translation JMLR 2024
Leveraging Large Language Models for NLG Evaluation: Advances and Challenges EMNLP 2024
Assessing Image-Captioning Models: A Novel Framework Integrating Statistical Analysis and Metric Patterns COLING 2024
Towards Human-aligned Evaluation for Linear Programming Word Problems COLING 2024
DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generation ACL 2024
Improving Automatic VQA Evaluation Using Large Language Models AAAI 2024
LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores ACL 2024
Small Objects Matters in Weakly-Supervised Semantic Segmentation WACV 2024