Evaluation

A Comparative Study of Faithfulness Metrics for Model Interpretability Methods ACL 2022 Agreement-on-the-line: Predicting the Performance of Neural Networks under Distribution Shift NeurIPS 2022 Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models EMNLP 2022 Assessing the Linguistic Knowledge in Arabic Pre-trained Language Models Using Minimal Pairs EMNLP 2022 AutoML Two-Sample Test NeurIPS 2022 BackdoorBench: A Comprehensive Benchmark of Backdoor Learning NeurIPS 2022 BenchIE: A Framework for Multi-Faceted Fact-Based Open Information Extraction Evaluation ACL 2022 Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics ACL 2022 BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation EMNLP 2022 BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation NAACL 2022 Calibration Meets Explanation: A Simple and Effective Approach for Model Confidence Estimates EMNLP 2022 Deconfounded Representation Similarity for Comparison of Neural Networks NeurIPS 2022 DEMETR: Diagnosing Evaluation Metrics for Translation EMNLP 2022 Distilled Gradient Aggregation: Purify Features for Input Attribution in the Deep Neural Network NeurIPS 2022 Do Feature Attribution Methods Correctly Attribute Features? AAAI 2022 Down and Across: Introducing Crossword-Solving as a New NLP Benchmark ACL 2022 Enabling Detailed Action Recognition Evaluation Through Video Dataset Augmentation NeurIPS 2022 Entropy- and Distance-Based Predictors From GPT-2 Attention Patterns Predict Reading Times Over and Above GPT-2 Surprisal EMNLP 2022 ePiC: Employing Proverbs in Context as a Benchmark for Abstract Language Understanding ACL 2022 FALTE: A Toolkit for Fine-grained Annotation for Long Text Evaluation EMNLP 2022 Feeding What You Need by Understanding What You Learned ACL 2022 GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation EMNLP 2022 GULP: a prediction-based metric between representations NeurIPS 2022 Hard Gate Knowledge Distillation - Leverage Calibration for Robust and Reliable Language Model EMNLP 2022 How General-Purpose Is a Language Model? Usefulness and Safety with Human Prompters in the Wild AAAI 2022