Evaluation

CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation EMNLP 2024 CORES: Convolutional Response-based Score for Out-of-distribution Detection CVPR 2024 CoSy: Evaluating Textual Explanations of Neurons NeurIPS 2024 Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models NeurIPS 2024 Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regression AAAI 2024 Does Object Grounding Really Reduce Hallucination of Large Vision-Language Models? EMNLP 2024 Do LLMs Overcome Shortcut Learning? An Evaluation of Shortcut Challenges in Large Language Models EMNLP 2024 Downstream Trade-offs of a Family of Text Watermarks EMNLP 2024 EconNLI: Evaluating Large Language Models on Economics Reasoning ACL 2024 Efficient Lifelong Model Evaluation in an Era of Rapid Progress NeurIPS 2024 Empowering CAM-Based Methods with Capability to Generate Fine-Grained and High-Faithfulness Explanations AAAI 2024 Evaluating Automatic Metrics with Incremental Machine Translation Systems EMNLP 2024 Evaluating Mathematical Reasoning of Large Language Models: A Focus on Error Identification and Correction ACL 2024 Evaluating Numerical Reasoning in Text-to-Image Models NeurIPS 2024 Evaluating the Elementary Multilingual Capabilities of Large Language Models with MultiQ ACL 2024 Evaluating the Smooth Control of Attribute Intensity in Text Generation with LLMs ACL 2024 Evalverse: Unified and Accessible Library for Large Language Model Evaluation EMNLP 2024 Exploring Defeasibility in Causal Reasoning ACL 2024 Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers EMNLP 2024 Fill In The Gaps: Model Calibration and Generalization with Synthetic Data EMNLP 2024 FlashEval: Towards Fast and Accurate Evaluation of Text-to-image Diffusion Generative Models CVPR 2024 Forgetting Curve: A Reliable Method for Evaluating Memorization Capability for Long-Context Models EMNLP 2024 FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models EMNLP 2024 FreeMan: Towards Benchmarking 3D Human Pose Estimation under Real-World Conditions CVPR 2024 GAOKAO-MM: A Chinese Human-Level Benchmark for Multimodal Models Evaluation ACL 2024