fine-grained evaluation

ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large Language Models ACL 2024 DINGO: Towards Diverse and Fine-Grained Instruction-Following Evaluation AAAI 2024 FAC2E: Better Understanding Large Language Model Capabilities by Dissociating Language and Cognition EMNLP 2024 FineSurE: Fine-grained Summarization Evaluation using LLMs ACL 2024 FIZZ: Factual Inconsistency Detection by Zoom-in Summary and Zoom-out Document EMNLP 2024 FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets ICLR 2024 Knowledge-Centric Hallucination Detection EMNLP 2024 MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues ACL 2024 MultiSkill: Evaluating Large Multimodal Models for Fine-grained Alignment Skills EMNLP 2024 Navigating the Nuances: A Fine-grained Evaluation of Vision-Language Navigation EMNLP 2024 Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation ACL 2024 CAST: Conditional Attribute Subsampling Toolkit for Fine-Grained Evaluation WACV 2023 DeltaScore: Fine-Grained Story Evaluation with Perturbations EMNLP 2023 FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generation NeurIPS 2023 InfoMetIC: An Informative Metric for Reference-free Image Caption Evaluation ACL 2023 Linguistically Motivated Evaluation of the 2023 State-of-the-art Machine Translation: Can ChatGPT Outperform NMT? EMNLP 2023 MISMATCH: Fine-grained Evaluation of Machine-generated Text with Mismatch Error Types ACL 2023 The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation EMNLP 2023 Thresh: A Unified, Customizable and Deployable Platform for Fine-Grained Text Evaluation EMNLP 2023 Towards Interpretable and Efficient Automatic Reference-Based Summarization Evaluation EMNLP 2023 ELEVANT: A Fully Automatic Fine-Grained Entity Linking Evaluation and Analysis Tool EMNLP 2022 EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching CVPR 2022 Fine-grained Image Captioning with CLIP Reward NAACL 2022 KGxBoard: Explainable and Interactive Leaderboard for Evaluation of Knowledge Graph Completion Models EMNLP 2022 SelF-Eval: Self-supervised Fine-grained Dialogue Evaluation COLING 2022