evaluation metric

PEDANTS: Cheap but Effective and Interpretable Answer Equivalence EMNLP 2024 Pioneering Reliable Assessment in Text-to-Image Knowledge Editing: Leveraging a Fine-Grained Dataset and an Innovative Criterion EMNLP 2024 Polos: Multimodal Metric Learning from Human Feedback for Image Captioning CVPR 2024 Position: Quo Vadis, Unsupervised Time Series Anomaly Detection? ICML 2024 POSIX: A Prompt Sensitivity Index For Large Language Models EMNLP 2024 PrExMe! Large Scale Prompt Exploration of Open Source LLMs for Machine Translation and Summarization Evaluation EMNLP 2024 PSentScore: Evaluating Sentiment Polarity in Dialogue Summarization COLING 2024 RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generation NeurIPS 2024 Ranking Large Language Models without Ground Truth ACL 2024 Reassessing Evaluation Functions in Algorithmic Recourse: An Empirical Study from a Human-Centered Perspective IJCAI 2024 Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluations COLING 2024 Re-Evaluating Evaluation for Multilingual Summarization EMNLP 2024 Reference-Based Metrics Are Biased Against Blind and Low-Vision Users’ Image Description Preferences EMNLP 2024 Reference-based Metrics Disprove Themselves in Question Generation EMNLP 2024 REMATCH: Robust and Efficient Matching of Local Knowledge Graphs to Improve Structural and Semantic Similarity NAACL 2024 Rethinking FID: Towards a Better Evaluation Metric for Image Generation CVPR 2024 ROUGE-K: Do Your Summaries Have Keywords? NAACL 2024 SciGisPy: a Novel Metric for Biomedical Text Simplification via Gist Inference Score EMNLP 2024 SeMaScore: A new evaluation metric for automatic speech recognition tasks Interspeech 2024 SIERA: An Evaluation Metric for Text Simplification using the Ranking Model and Data Augmentation by Edit Operations COLING 2024 SignBLEU: Automatic Evaluation of Multi-channel Sign Language Translation COLING 2024 Size-invariance Matters: Rethinking Metrics and Losses for Imbalanced Multi-object Salient Object Detection ICML 2024 Small Objects Matters in Weakly-Supervised Semantic Segmentation WACV 2024 Soft metrics for evaluation with disagreements: an assessment COLING 2024 SpeechAlign: A Framework for Speech Translation Alignment Evaluation COLING 2024