Evaluation

ODD: Overlap-aware Estimation of Model Performance under Distribution Shift UAI 2025 OGBench: Benchmarking Offline Goal-Conditioned RL ICLR 2025 Overestimated performance of auditory attention decoding caused by experimental design in EEG recordings Interspeech 2025 Polyrating: A Cost-Effective and Bias-Aware Rating System for LLM Evaluation ICLR 2025 RELATE: Subjective evaluation dataset for automatic evaluation of relevance between text and audio Interspeech 2025 SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Information Interspeech 2025 SDBench: A Comprehensive Benchmark Suite for Speaker Diarization Interspeech 2025 SOO-Bench: Benchmarks for Evaluating the Stability of Offline Black-Box Optimization ICLR 2025 SOVA-Bench: Benchmarking the Speech Conversation Ability for LLM-based Voice Assistant Interspeech 2025 Speech-IFEval: Evaluating Instruction-Following and Quantifying Catastrophic Forgetting in Speech-Aware Language Models Interspeech 2025 Speech Robust Bench: A Robustness Benchmark For Speech Recognition ICLR 2025 The 2024 NIST Speaker Recognition Evaluation Interspeech 2025 The Consistency Hypothesis in Uncertainty Quantification for Large Language Models UAI 2025 The Interspeech 2025 Challenge on Speech Emotion Recognition in Naturalistic Conditions Interspeech 2025 The Interspeech 2025 Speech Accessibility Project Challenge Interspeech 2025 The ML-SUPERB 2.0 Challenge: Towards Inclusive ASR Benchmarking for All Language Varieties Interspeech 2025 The State Of TTS: A Case Study with Human Fooling Rates Interspeech 2025 TOMATO: Assessing Visual Temporal Reasoning Capabilities in Multimodal Foundation Models ICLR 2025 Towards a Principled Evaluation of Knowledge Editors ACL 2025 Towards a Unified Benchmark for Arabic Pronunciation Assessment: Qur’anic Recitation as Case Study Interspeech 2025 Towards Frame-level Quality Predictions of Synthetic Speech Interspeech 2025 Turing's Echo: Investigating Linguistic Sensitivity of Deepfake Voice Detection via Gamification Interspeech 2025 UCSC at SemEval-2025 Task 3: Context, Models and Prompt Optimization for Automated Hallucination Detection in LLM Output SemEval 2025 Variability in performance across four generations of automatic speaker recognition systems Interspeech 2025 VideoWebArena: Evaluating Long Context Multimodal Agents with Video Understanding Web Tasks ICLR 2025