Evaluation

Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programming NeurIPS 2024 Benchmarking Segmentation Models with Mask-Preserved Attribute Editing CVPR 2024 BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices NeurIPS 2024 Better than Random: Reliable NLG Human Evaluation with Constrained Active Sampling AAAI 2024 Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics EMNLP 2024 Beyond Document Page Classification: Design, Datasets, and Challenges WACV 2024 Beyond Probabilities: Unveiling the Misalignment in Evaluating Large Language Models ACL 2024 Beyond Reference: Evaluating High Quality Translations Better than Human References EMNLP 2024 Beyond the Numbers: Transparency in Relation Extraction Benchmark Creation and Leaderboards EMNLP 2024 BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages NeurIPS 2024 BotEval: Facilitating Interactive Human Evaluation ACL 2024 Building a stable classifier with the inflated argmax NeurIPS 2024 Calibrating the Confidence of Large Language Models by Eliciting Fidelity EMNLP 2024 Can Automatic Metrics Assess High-Quality Translations? EMNLP 2024 Can Biases in ImageNet Models Explain Generalization? CVPR 2024 Can I trust You? LLMs as conversational agents EACL 2024 Can Language Models Recognize Convincing Arguments? EMNLP 2024 Can Large Language Models Always Solve Easy Problems if They Can Solve Harder Ones? EMNLP 2024 Can Large Language Models Faithfully Express Their Intrinsic Uncertainty in Words? EMNLP 2024 Can Large Language Models Interpret Noun-Noun Compounds? A Linguistically-Motivated Study on Lexicalized and Novel Compounds ACL 2024 Can Large Language Models Reason About Goal-Oriented Tasks? EACL 2024 Can LLM Graph Reasoning Generalize beyond Pattern Memorization? EMNLP 2024 Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs ACL 2024 Can LLMs replace Neil deGrasse Tyson? Evaluating the Reliability of LLMs as Science Communicators EMNLP 2024 Categorical Generative Model Evaluation via Synthetic Distribution Coarsening AISTATS 2024