automatic evaluation

imapScore: Medical Fact Evaluation Made Easy ACL 2024 Improving Automatic VQA Evaluation Using Large Language Models AAAI 2024 Investigating Content Planning for Navigating Trade-offs in Knowledge-Grounded Dialogue EACL 2024 IQA-EVAL: Automatic Evaluation of Human-Model Interactive Question Answering NeurIPS 2024 Is LLM a Reliable Reviewer? A Comprehensive Evaluation of LLM on Automatic Paper Reviewing Tasks COLING 2024 KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models ACL 2024 Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Course EMNLP 2024 Large Language Models as Automated Aligners for benchmarking Vision-Language Models ICLR 2024 LLMEval: A Preliminary Study on How to Evaluate Large Language Models AAAI 2024 LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores ACL 2024 MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization ACL 2024 Meta-Evaluation of Sentence Simplification Metrics COLING 2024 Mitigating the Impact of Reference Quality on Evaluation of Summarization Systems with Reference-Free Metrics EMNLP 2024 NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Journalism ACL 2024 Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References NAACL 2024 QGEval: Benchmarking Multi-dimensional Evaluation for Question Generation EMNLP 2024 Re-Evaluating Evaluation for Multilingual Summarization EMNLP 2024 Revisiting Automated Evaluation for Long-form Table Question Answering EMNLP 2024 Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs EMNLP 2024 SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metrics Interspeech 2024 StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Models ACL 2024 Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems EMNLP 2024 TAIL: A Toolkit for Automatic and Realistic Long-Context Large Language Model Evaluation EMNLP 2024 Unlocking Structure Measuring: Introducing PDD, an Automatic Metric for Positional Discourse Coherence NAACL 2024 VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation EMNLP 2024