Evaluation

DEnsity: Open-domain Dialogue Evaluation Metric using Density Estimation ACL 2023 Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmark ACL 2023 Did the Models Understand Documents? Benchmarking Models for Language Understanding in Document-Level Relation Extraction ACL 2023 Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models CVPR 2023 DiQAD: A Benchmark Dataset for Open-domain Dialogue Quality Assessment EMNLP 2023 Discovering Language Model Behaviors with Model-Written Evaluations ACL 2023 Discriminative Calibration: Check Bayesian Computation from Simulations and Flexible Classifier NeurIPS 2023 Distinguishing Romanized Hindi from Romanized Urdu ACL 2023 DLAMA: A Framework for Curating Culturally Diverse Facts for Probing the Knowledge of Pretrained Language Models ACL 2023 Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023? ACL 2023 Do “English” Named Entity Recognizers Work Well on Global Englishes? EMNLP 2023 Do Question Answering Modeling Improvements Hold Across Benchmarks? ACL 2023 DPAUC: Differentially Private AUC Computation in Federated Learning AAAI 2023 Dragonfly_captain at SemEval-2023 Task 11: Unpacking Disagreement with Investigation of Annotator Demographics and Task Difficulty SemEval 2023 Efficient Global Robustness Certification of Neural Networks via Interleaving Twin-Network Encoding (Extended Abstract) IJCAI 2023 Elo Uncovered: Robustness and Best Practices in Language Model Evaluation EMNLP 2023 Emergent Asymmetry of Precision and Recall for Measuring Fidelity and Diversity of Generative Models in High Dimensions ICML 2023 Emergent Inabilities? Inverse Scaling Over the Course of Pretraining EMNLP 2023 Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features ACL 2023 EPIC: Multi-Perspective Annotation of a Corpus of Irony ACL 2023 Error Estimation for Random Fourier Features AISTATS 2023 Establishing Trustworthiness: Rethinking Tasks and Model Evaluation EMNLP 2023 Estimating Large Language Model Capabilities without Labeled Test Data EMNLP 2023 EVALIGN: Visual Evaluation of Translation Alignment Models EACL 2023 Evaluating Cross-Domain Text-to-SQL Models and Benchmarks EMNLP 2023