Evaluation

Where am I? Large Language Models Wandering between Semantics and Structures in Long Contexts EMNLP 2024 A Better Way to Do Masked Language Model Scoring ACL 2023 AIO-P: Expanding Neural Performance Predictors beyond Image Classification AAAI 2023 A Large-Scale Homography Benchmark CVPR 2023 Analyzing Multilingual Competency of LLMs in Multi-Turn Instruction Following: A Case Study of Arabic EMNLP 2023 A New Benchmark and Reverse Validation Method for Passage-level Hallucination Detection EMNLP 2023 Beyond mAP: Towards Better Evaluation of Instance Segmentation CVPR 2023 CARE-MI: Chinese Benchmark for Misinformation Evaluation in Maternity and Infant Care NeurIPS 2023 Common Law Annotations: Investigating the Stability of Dialog System Output Annotations ACL 2023 CReTIHC: Designing Causal Reasoning Tasks about Temporal Interventions and Hallucinated Confoundings EMNLP 2023 Cross-Modal Attribute Insertions for Assessing the Robustness of Vision-and-Language Learning ACL 2023 Discriminative Feature Attributions: Bridging Post Hoc Explainability and Inherent Interpretability NeurIPS 2023 Easy to Decide, Hard to Agree: Reducing Disagreements Between Saliency Methods ACL 2023 Ecosystem-level Analysis of Deployed Machine Learning Reveals Homogeneous Outcomes NeurIPS 2023 Exploring Context-Aware Evaluation Metrics for Machine Translation EMNLP 2023 Feature Likelihood Divergence: Evaluating the Generalization of Generative Models Using Samples NeurIPS 2023 “Fifty Shades of Bias”: Normative Ratings of Gender Bias in GPT Generated English Text EMNLP 2023 HalOmi: A Manually Annotated Benchmark for Multilingual Hallucination and Omission Detection in Machine Translation EMNLP 2023 ImageNet-Hard: The Hardest Images Remaining from a Study of the Power of Zoom and Spatial Biases in Image Classification NeurIPS 2023 INVITE: a Testbed of Automatically Generated Invalid Questions to Evaluate Large Language Models for Hallucinations EMNLP 2023 LINe: Out-of-Distribution Detection by Leveraging Important Neurons CVPR 2023 Measuring the Instability of Fine-Tuning ACL 2023 Measuring the Knowledge Acquisition-Utilization Gap in Pretrained Language Models EMNLP 2023 MEGA: Multilingual Evaluation of Generative AI EMNLP 2023 MISMATCH: Fine-grained Evaluation of Machine-generated Text with Mismatch Error Types ACL 2023