Evaluation

AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents NeurIPS 2024 “A good pun is its own reword”: Can Large Language Models Understand Puns? EMNLP 2024 AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension ACL 2024 AKEW: Assessing Knowledge Editing in the Wild EMNLP 2024 Algorithmic progress in language models NeurIPS 2024 AlignBench: Benchmarking Chinese Alignment of Large Language Models ACL 2024 ALIGN-SIM: A Task-Free Test Bed for Evaluating and Interpreting Sentence Embeddings through Semantic Similarity Alignment EMNLP 2024 A linguistically-motivated evaluation methodology for unraveling model’s abilities in reading comprehension tasks EMNLP 2024 A LLM-based Ranking Method for the Evaluation of Automatic Counter-Narrative Generation EMNLP 2024 AMLB: an AutoML Benchmark JMLR 2024 ANAH: Analytical Annotation of Hallucinations in Large Language Models ACL 2024 ANAH-v2: Scaling Analytical Hallucination Annotation of Large Language Models NeurIPS 2024 Analyzing Explainer Robustness via Probabilistic Lipschitzness of Prediction Functions AISTATS 2024 Analyzing LLM Behavior in Dialogue Summarization: Unveiling Circumstantial Hallucination Trends ACL 2024 An Analysis of Multilingual FActScore EMNLP 2024 An Audit on the Perspectives and Challenges of Hallucinations in NLP EMNLP 2024 An Empirical Analysis on Large Language Models in Debate Evaluation ACL 2024 An Empirical Investigation Into Benchmarking Model Multiplicity for Trustworthy Machine Learning: A Case Study on Image Classification WACV 2024 An engine not a camera: Measuring performative power of online search NeurIPS 2024 An Entropy-based Text Watermarking Detection Method ACL 2024 An Evaluation Mechanism of LLM-based Agents on Manipulating APIs EMNLP 2024 Anomaly Score: Evaluating Generative Models and Individual Generated Images based on Complexity and Vulnerability CVPR 2024 A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners EMNLP 2024 A Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captions CVPR 2024 APPLS: Evaluating Evaluation Metrics for Plain Language Summarization EMNLP 2024