Evaluation

ConvCodeWorld: Benchmarking Conversational Code Generation in Reproducible Feedback Environments ICLR 2025 CrossPyEval: Enhancing LLM-based Evaluation of Low-Resource Code via Code Translation ACML 2025 Crowdsourcing MUSHRA Tests in the Age of Generative Speech Technologies: A Comparative Analysis of Subjective and Objective Testing Methods Interspeech 2025 Developing a Top-tier Framework in Naturalistic Conditions Challenge for Categorized Emotion Prediction: From Speech Foundation Models and Learning Objective to Data Augmentation and Engineering Choices Interspeech 2025 Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMs ICLR 2025 Do you read me? - flow of speech effect on speaker recognition systems Interspeech 2025 Enabling the replicability of speech synthesis perceptual evaluations Interspeech 2025 Evaluating Prediction-based Interventions with Human Decision Makers In Mind AISTATS 2025 Evaluating Speech Enhancement Performance Across Demographics and Language Interspeech 2025 Evaluating Text Style Transfer Evaluation: Are There Any Reliable Metrics? NAACL 2025 Fantastic Copyrighted Beasts and How (Not) to Generate Them ICLR 2025 FD-Bench: A Full-Duplex Benchmarking Pipeline Designed for Full Duplex Spoken Dialogue Systems Interspeech 2025 From Pretraining to Performance: Benchmarking Self-Supervised Speech Models for Interspeech-25 SER Challenge Interspeech 2025 From Stories to Statistics: Methodological Biases in LLM-Based Narrative Flow Quantification CoNLL 2025 Generalised Probabilistic Modelling and Improved Uncertainty Estimation in Comparative LLM-as-a-judge UAI 2025 HASARD: A Benchmark for Vision-Based Safe Reinforcement Learning in Embodied Agents ICLR 2025 Intelligibility of Text-to-Speech Systems for Mathematical Expressions Interspeech 2025 I-trustworthy Models. A framework for trustworthiness evaluation of probabilistic classifiers AISTATS 2025 Just Trial Once: Ongoing Causal Validation of Machine Learning Models UAI 2025 Legally validated evaluation framework for voice anonymization Interspeech 2025 Legitimate ground-truth-free metrics for deep uncertainty classification scoring AISTATS 2025 Lost in Variation? Evaluating NLI Performance in Basque and Spanish Geographical Variants CoNLL 2025 Model Evaluation in the Dark: Robust Classifier Metrics with Missing Labels AISTATS 2025 Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMs ICLR 2025 NIRANTAR: Continual Learning with New Languages and Domains on Real-world Speech Data Interspeech 2025