Skip to content
conftrace_

evaluation benchmark

273 papers

Papers

Permitted Knowledge Boundary: Evaluating the Knowledge-Constrained Responsiveness of Large Language Models EMNLP 2025 PhD: A ChatGPT-Prompted Visual Hallucination Evaluation Dataset CVPR 2025 PhysicsEval: Inference-Time Techniques to Improve the Reasoning Proficiency of Large Language Models on Physics Problems IJCNLP 2025 PlanningArena: A Modular Benchmark for Multidimensional Evaluation of Planning and Tool Learning ACL 2025 ProJudge: A Multi-Modal Multi-Discipline Benchmark and Instruction-Tuning Dataset for MLLM-based Process Judges ICCV 2025 ReIFE: Re-evaluating Instruction-Following Evaluation NAACL 2025 RusConText Benchmark: A Russian Language Evaluation Benchmark for Understanding Context ACL 2025 SEOE: A Scalable and Reliable Semantic Evaluation Framework for Open Domain Event Detection ACL 2025 Simulating Training Data Leakage in Multiple-Choice Benchmarks for LLM Evaluation AACL 2025 SocialEval: Evaluating Social Intelligence of Large Language Models ACL 2025 Speech-IFEval: Evaluating Instruction-Following and Quantifying Catastrophic Forgetting in Speech-Aware Language Models Interspeech 2025 SpeechIQ: Speech-Agentic Intelligence Quotient Across Cognitive Levels in Voice Understanding by Large Language Models ACL 2025 Summarizing Speech: A Comprehensive Survey EMNLP 2025 The 2025 ReproNLP Shared Task on Reproducibility of Evaluations in NLP: Overview and Results ACL 2025 The Mirage of Model Editing: Revisiting Evaluation in the Wild ACL 2025 The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varieties Interspeech 2025 Theory of Mind in Large Language Models: Assessment and Enhancement ACL 2025 Think Globally, Group Locally: Evaluating LLMs Using Multi-Lingual Word Grouping Games EMNLP 2025 TLUE: A Tibetan Language Understanding Evaluation Benchmark EMNLP 2025 Towards Better Evaluation for Generated Patent Claims ACL 2025 Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Survey EMNLP 2025 Trade-offs in Image Generation: How Do Different Dimensions Interact? ICCV 2025 Trojsten Benchmark: Evaluating LLM Problem-Solving in Slovak STEM Competition Problems EMNLP 2025 Unifying AI Tutor Evaluation: An Evaluation Taxonomy for Pedagogical Ability Assessment of LLM-Powered AI Tutors NAACL 2025 VF-Eval: Evaluating Multimodal LLMs for Generating Feedback on AIGC Videos ACL 2025