evaluation metric

FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation ACL 2025 FLEX: Expert-level False-Less EXecution Metric for Text-to-SQL Benchmark NAACL 2025 Fréchet Wavelet Distance: A Domain-Agnostic Metric for Image Generation ICLR 2025 gec-metrics: A Unified Library for Grammatical Error Correction Evaluation ACL 2025 GEMMAS: Graph-based Evaluation Metrics for Multi Agent Systems EMNLP 2025 Gen3DEval: Using vLLMs for Automatic Evaluation of Generated 3D Objects CVPR 2025 Guiding Vision-Language Model Selection for Visual Question-Answering Across Tasks, Domains, and Knowledge Types COLING 2025 Has Machine Translation Evaluation Achieved Human Parity? The Human Reference and the Limits of Progress ACL 2025 Identifying Reliable Evaluation Metrics for Scientific Text Revision ACL 2025 Image Captioning Evaluation in the Age of Multimodal LLMs: Challenges and Future Perspectives IJCAI 2025 Image Over Text: Transforming Formula Recognition Evaluation with Character Detection Matching CVPR 2025 InspectorRAGet: An Introspection Platform for RAG Evaluation NAACL 2025 Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models ACL 2025 LASER: An LLM-based ASR Scoring and Evaluation Rubric EMNLP 2025 Lessons Learned from the URGENT 2024 Speech Enhancement Challenge Interspeech 2025 LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMs NAACL 2025 Lost in Transcription, Found in Distribution Shift: Demystifying Hallucination in Speech Foundation Models ACL 2025 LRMGS: A Language-Robust Metric for Evaluating Question Answering in Very Low-Resource Indic Languages IJCNLP 2025 MDSEval: A Meta-Evaluation Benchmark for Multimodal Dialogue Summarization EMNLP 2025 Meaningful Pose-Based Sign Language Evaluation EMNLP 2025 Metric Calculating Benchmark: Code-Verifiable Complicate Instruction Following Benchmark for Large Language Models EMNLP 2025 MIRAGE: A Metric-Intensive Benchmark for Retrieval-Augmented Generation Evaluation NAACL 2025 MITRA-zh-eval: Using a Buddhist Chinese Language Evaluation Dataset to Assess Machine Translation and Evaluation Metrics NAACL 2025 MSLC25: Metric Performance on Low-Quality Machine Translation, Empty Strings, and Language Variants EMNLP 2025 MT-LENS: An all-in-one Toolkit for Better Machine Translation Evaluation NAACL 2025