Evaluation

A Statistical Learning Take on the Concordance Index for Survival Analysis AISTATS 2023 A Survey of Evaluation Methods of Generated Medical Textual Reports ACL 2023 A Two-Sided Discussion of Preregistration of NLP Research EACL 2023 AUC-based Selective Classification AISTATS 2023 Automated Classification of Model Errors on ImageNet NeurIPS 2023 Automated Metrics for Medical Multi-Document Summarization Disagree with Human Evaluations ACL 2023 Automatically Auditing Large Language Models via Discrete Optimization ICML 2023 Automatic Analysis of Substantiation in Scientific Peer Reviews EMNLP 2023 Average Token Delay: A Latency Metric for Simultaneous Translation Interspeech 2023 Back Transcription as a Method for Evaluating Robustness of Natural Language Understanding Models to Speech Recognition Errors EMNLP 2023 Balanced Off-Policy Evaluation for Personalized Pricing AISTATS 2023 Benchmarking Offensive and Abusive Language in Dutch Tweets ACL 2023 Beyond Confidence: Reliable Models Should Also Consider Atypicality NeurIPS 2023 Beyond mAP: Towards Better Evaluation of Instance Segmentation CVPR 2023 bgGLUE: A Bulgarian General Language Understanding Evaluation Benchmark ACL 2023 Blackbird language matrices (BLM), a new task for rule-like generalization in neural networks: Can Large Language Models pass the test? EMNLP 2023 BLASER: A Text-Free Speech-to-Speech Translation Evaluation Metric ACL 2023 BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training ACL 2023 Bootstrap in High Dimension with Low Computation ICML 2023 Bugs in the Data: How ImageNet Misrepresents Biodiversity AAAI 2023 BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics ACL 2023 Calibrating a Deep Neural Network with Its Predecessors IJCAI 2023 Calibration by Distribution Matching: Trainable Kernel Calibration Metrics NeurIPS 2023 Can ChatGPT Defend its Belief in Truth? Evaluating LLM Reasoning via Debate EMNLP 2023 Can ChatGPT Understand Causal Language in Science Claims? ACL 2023