Evaluation

Mutual Information Divergence: A Unified Metric for Multimodal Generative Models NeurIPS 2022 Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets EMNLP 2022 NeoRL: A Near Real-World Benchmark for Offline Reinforcement Learning NeurIPS 2022 Nibbling at the Hard Core of Word Sense Disambiguation ACL 2022 Non-Autoregressive Machine Translation: It’s Not as Fast as it Seems NAACL 2022 Not a Number: Identifying Instance Features for Capability-Oriented Evaluation IJCAI 2022 Numerical Correlation in Text EMNLP 2022 On Length Divergence Bias in Textual Matching Models ACL 2022 On Measuring the Intrinsic Few-Shot Hardness of Datasets EMNLP 2022 On reporting scores and agreement for error annotation tasks EMNLP 2022 On Scalable Testing of Samplers NeurIPS 2022 On Structured Filtering-Clustering: Global Error Bound and Optimal First-Order Algorithms AISTATS 2022 On the Calibration of Pre-trained Language Models using Mixup Guided by Area Under the Margin and Saliency ACL 2022 On the data requirements of probing ACL 2022 On the Diversity and Limits of Human Explanations NAACL 2022 On the Effectiveness of Automated Metrics for Text Generation Systems EMNLP 2022 On the Impact of Noises in Crowd-Sourced Data for Speech Translation ACL 2022 On the Impact of Temporal Concept Drift on Model Explanations EMNLP 2022 On the Limits of Evaluating Embodied Agent Model Generalization Using Validation Sets ACL 2022 On the Machine Learning of Ethical Judgments from Natural Language NAACL 2022 On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models? NAACL 2022 On the Robustness of Reading Comprehension Models to Entity Renaming NAACL 2022 On the Use of Unrealistic Predictions in Hundreds of Papers Evaluating Graph Representations AAAI 2022 OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalization CVPR 2022 OpenAUC: Towards AUC-Oriented Open-Set Recognition NeurIPS 2022