benchmark evaluation

Firm or Fickle? Evaluating Large Language Models Consistency in Sequential Interactions ACL 2025 FLAMES: Improving LLM Math Reasoning via a Fine-Grained Analysis of the Data Synthesis Pipeline EMNLP 2025 FlashAdventure: A Benchmark for GUI Agents Solving Full Story Arcs in Diverse Adventure Games EMNLP 2025 Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs EMNLP 2025 FlexUOD: The Answer to Real-world Unsupervised Image Outlier Detection CVPR 2025 FLUID QA: A Multilingual Benchmark for Figurative Language Usage in Dialogue across English, Chinese, and Korean EMNLP 2025 FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions NAACL 2025 FoREST: Frame of Reference Evaluation in Spatial Reasoning Tasks EMNLP 2025 Forget What You Know about LLMs Evaluations - LLMs are Like a Chameleon EMNLP 2025 From Facts to Folklore: Evaluating Large Language Models on Bengali Cultural Knowledge IJCNLP 2025 From Remembering to Metacognition: Do Existing Benchmarks Accurately Evaluate LLMs? EMNLP 2025 FrontierScience Bench: Evaluating AI Research Capabilities in LLMs ACL 2025 GaRAGe: A Benchmark with Grounding Annotations for RAG Evaluation ACL 2025 GenAI Content Detection Task 3: Cross-Domain Machine Generated Text Detection Challenge COLING 2025 Generating Q&A Benchmarks for RAG Evaluation in Enterprise Settings ACL 2025 GIMMICK: Globally Inclusive Multimodal Multitask Cultural Knowledge Benchmarking ACL 2025 GitGoodBench: A Novel Benchmark For Evaluating Agentic Performance On Git ACL 2025 Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation ACL 2025 GLoRa: A Benchmark to Evaluate the Ability to Learn Long-Range Dependencies in Graphs ICLR 2025 GlotEval: A Test Suite for Massively Multilingual Evaluation of Large Language Models EMNLP 2025 “Going to a trap house” conveys more fear than “Going to a mall”: Benchmarking Emotion Context Sensitivity for LLMs EMNLP 2025 Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Models EMNLP 2025 GRACE: A Granular Benchmark for Evaluating Model Calibration against Human Calibration ACL 2025 GraCoRe: Benchmarking Graph Comprehension and Complex Reasoning in Large Language Models COLING 2025 GraphArena: Evaluating and Exploring Large Language Models on Graph Computation ICLR 2025