benchmark evaluation

BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games ICLR 2025 BALSAM: A Platform for Benchmarking Arabic Large Language Models EMNLP 2025 BannerBench: Benchmarking Vision Language Models for Multi-Ad Selection with Human Preferences EMNLP 2025 BasqBBQ: A QA Benchmark for Assessing Social Biases in LLMs for Basque, a Low-Resource Language COLING 2025 Batayan: A Filipino NLP benchmark for evaluating Large Language Models ACL 2025 BelarusianGLUE: Towards a Natural Language Understanding Benchmark for Belarusian ACL 2025 Benchmarking and Building Zero-Shot Hindi Retrieval Model with Hindi-BEIR and NLLB-E5 NAACL 2025 Benchmarking Contextual and Paralinguistic Reasoning in Speech-LLMs: A Case Study with In-the-Wild Data EMNLP 2025 Benchmarking Deep Search over Heterogeneous Enterprise Data EMNLP 2025 Benchmarking Distributional Alignment of Large Language Models NAACL 2025 Benchmarking Hindi LLMs: A New Suite of Datasets and a Comparative Analysis AACL 2025 Benchmarking Large Language Models Under Data Contamination: A Survey from Static to Dynamic Evaluation EMNLP 2025 Benchmarking LLMs and LLM-based Agents in Practical Vulnerability Detection for Code Repositories ACL 2025 Benchmarking LLMs on Semantic Overlap Summarization EMNLP 2025 Benchmarking Long-Context Language Models on Long Code Understanding ACL 2025 Benchmarking Multimodal Large Language Models Against Image Corruptions ICCV 2025 Benchmarking Multimodal Models for Ukrainian Language Understanding Across Academic and Cultural Domains ACL 2025 Benchmarking Multi-National Value Alignment for Large Language Models ACL 2025 Benchmarking the Benchmarks: Reproducing Climate-Related NLP Tasks ACL 2025 Benchmarking the Performance of Pre-trained LLMs across Urdu NLP Tasks COLING 2025 Benchmark Profiling: Mechanistic Diagnosis of LLM Benchmarks EMNLP 2025 BenNumEval: A Benchmark to Assess LLMs’ Numerical Reasoning Capabilities in Bengali ACL 2025 Beyond Browsing: API-Based Web Agents ACL 2025 Beyond Clean Training Data: A Versatile and Model-Agnostic Framework for Out-of-Distribution Detection with Contaminated Training Data CVPR 2025 Beyond Graphs: Can Large Language Models Comprehend Hypergraphs? ICLR 2025