benchmark framework

Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams ACL 2026 promptolution: A Unified, Modular Framework for Prompt Optimization EACL 2026 VABench: A Comprehensive Benchmark for Audio-Video Generation CVPR 2026 CitaLaw: Enhancing LLM with Citations in Legal Domain ACL 2025 MCPEval: Automatic MCP-based Deep Evaluation for AI Agent Models EMNLP 2025 Tau-Eval: A Unified Evaluation Framework for Useful and Private Text Anonymization EMNLP 2025 Truth, Trust, and Trouble: Medical AI on the Edge EMNLP 2025 WeQA: A Benchmark for Retrieval Augmented Generation in Wind Energy Domain ACL 2025 AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents NeurIPS 2024 AgentQuest: A Modular Benchmark Framework to Measure Progress and Improve LLM Agents NAACL 2024 Benchmarking Implicit Neural Representation and Geometric Rendering in Real-Time RGB-D SLAM CVPR 2024 Benchmarking Spurious Bias in Few-Shot Image Classifiers ECCV 2024 FlexMol: A Flexible Toolkit for Benchmarking Molecular Relational Learning NeurIPS 2024 MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaboration EMNLP 2024 A framework for benchmarking Class-out-of-distribution detection and its application to ImageNet ICLR 2023 BenchIE: A Framework for Multi-Faceted Fact-Based Open Information Extraction Evaluation ACL 2022 Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks ACL 2022 ECO v1: Towards Event-Centric Opinion Mining ACL 2022 LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech Interspeech 2021 GSLAM: A General SLAM Framework and Benchmark ICCV 2019