Evaluation

Richer Countries and Richer Representations ACL 2022 SEAL: Interactive Tool for Systematic Error Analysis and Labeling EMNLP 2022 SEM-F1: an Automatic Way for Semantic Evaluation of Multi-Narrative Overlap Summaries at Scale EMNLP 2022 Spectral Bias in Practice: The Role of Function Frequency in Generalization NeurIPS 2022 SwapMix: Diagnosing and Regularizing the Over-Reliance on Visual Context in Visual Question Answering CVPR 2022 The DEVIL Is in the Details: A Diagnostic Evaluation Benchmark for Video Inpainting CVPR 2022 Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluation EMNLP 2022 Towards Robust Numerical Question Answering: Diagnosing Numerical Capabilities of NLP Systems EMNLP 2022 Video compression dataset and benchmark of learning-based video-quality metrics NeurIPS 2022 VisCUIT: Visual Auditor for Bias in CNN Image Classifier CVPR 2022 When does dough become a bagel? Analyzing the remaining mistakes on ImageNet NeurIPS 2022 A Closer Look at Fourier Spectrum Discrepancies for CNN-Generated Images Detection CVPR 2021 Anaphora Resolution in Dialogue: Cross-Team Analysis of the DFKI-TalkingRobots Team Submissions for the CODI-CRAC 2021 Shared-Task EMNLP 2021 A Novel Visual Interpretability for Deep Neural Networks by Optimizing Activation Maps with Perturbation AAAI 2021 Are VQA Systems RAD? Measuring Robustness to Augmented Data with Focused Interventions ACL 2021 Automatic Text Evaluation through the Lens of Wasserstein Barycenters EMNLP 2021 Building Reliable Explanations of Unreliable Neural Networks: Locally Smoothing Perspective of Model Interpretation CVPR 2021 CAMERAS: Enhanced Resolution and Sanity Preserving Class Activation Mapping for Image Saliency CVPR 2021 CIDEr-R: Robust Consensus-based Image Description Evaluation EMNLP 2021 Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation EMNLP 2021 Controlled tasks for model analysis: Retrieving discrete information from sequences EMNLP 2021 Debiasing Methods in Natural Language Understanding Make Bias More Accessible EMNLP 2021 DELA Corpus - A Document-Level Corpus Annotated with Context-Related Issues EMNLP 2021 Discretized Integrated Gradients for Explaining Language Models EMNLP 2021 Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution ACL 2021