model evaluation

Systematic Evaluation of Long-Context LLMs on Financial Concepts EMNLP 2024 TabRepo: A Large Scale Repository of Tabular Model Evaluations and its AutoML Applications AutoML 2024 The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Models ACL 2024 The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models EMNLP 2024 TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models ACL 2024 ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models EMNLP 2024 Towards Automated Evaluation of Knowledge Encoded in Large Language Models COLING 2024 Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps EMNLP 2024 UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs ACL 2024 UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling NeurIPS 2024 Weak Supervision Performance Evaluation via Partial Identification NeurIPS 2024 What Factors Influence LLMs’ Judgments? A Case Study on Question Answering COLING 2024 What is lost in Normalization? Exploring Pitfalls in Multilingual ASR Model Evaluations EMNLP 2024 What Kind of Sourcery is This? Evaluating GPT-4’s Performance on Linking Scientific Fact to Citations EMNLP 2024 What's Outside the Intersection? Fine-Grained Error Analysis for Semantic Segmentation Beyond IoU WACV 2024 WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences NeurIPS 2024 XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models NAACL 2024 ABLATOR: Robust Horizontal-Scaling of Machine Learning Ablation Experiments AutoML 2023 ActiveAED: A Human in the Loop Improves Annotation Error Detection ACL 2023 Actively Testing Your Model While It Learns: Realizing Label-Efficient Learning in Practice NeurIPS 2023 A Kernelized Stein Discrepancy for Biological Sequences ICML 2023 AlGhafa Evaluation Benchmark for Arabic Language Models EMNLP 2023 Analyzing Bias in Large Language Model Solutions for Assisted Writing Feedback Tools: Lessons from the Feedback Prize Competition Series ACL 2023 An Effective Meaningful Way to Evaluate Survival Models ICML 2023 Are Human Explanations Always Helpful? Towards Objective Evaluation of Human Natural Language Explanations ACL 2023