Evaluation

Impact of Evaluation Methodologies on Code Summarization ACL 2022 IMPLI: Investigating NLI Models’ Performance on Figurative Language ACL 2022 Improved Evaluation of Automatic Source Code Summarisation EMNLP 2022 Introspective Learning : A Two-Stage approach for Inference in Neural Networks NeurIPS 2022 Iterative Stratified Testing and Measurement for Automated Model Updates EMNLP 2022 Logic Rule Guided Attribution with Dynamic Ablation AAAI 2022 Logic Traps in Evaluating Attribution Scores ACL 2022 Making Science Simple: Corpora for the Lay Summarisation of Scientific Literature EMNLP 2022 Measuring Compositional Consistency for Video Question Answering CVPR 2022 Merry Go Round: Rotate a Frame and Fool a DNN CVPR 2022 MINIMAL: Mining Models for Universal Adversarial Triggers AAAI 2022 Model Criticism for Long-Form Text Generation EMNLP 2022 Model Doctor: A Simple Gradient Aggregation Strategy for Diagnosing and Treating CNN Classifiers AAAI 2022 MORA: Improving Ensemble Robustness Evaluation with Model Reweighing Attack NeurIPS 2022 MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translation EMNLP 2022 NAS-Bench-360: Benchmarking Neural Architecture Search on Diverse Tasks NeurIPS 2022 Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets EMNLP 2022 Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error Synthesis EMNLP 2022 On Measuring the Intrinsic Few-Shot Hardness of Datasets EMNLP 2022 On the Importance of Data Size in Probing Fine-tuned Models ACL 2022 On the Sensitivity and Stability of Model Interpretations in NLP ACL 2022 Pass off Fish Eyes for Pearls: Attacking Model Selection of Pre-trained Models ACL 2022 Reproducibility Issues for BERT-based Evaluation Metrics EMNLP 2022 Rethinking and Refining the Distinct Metric ACL 2022 Revisiting Grammatical Error Correction Evaluation and Beyond EMNLP 2022