Evaluation

Voice Conversion for Likability Control via Automated Rating of Speech Synthesis Corpora Interspeech 2025 VoxAging: Continuously Tracking Speaker Aging with a Large-Scale Longitudinal Dataset in English and Mandarin Interspeech 2025 VoxDialogue: Can Spoken Dialogue Systems Understand Information Beyond Words? ICLR 2025 What Do Humans Hear When Interacting? Experiments on Selective Listening for Evaluating ASR of Spoken Dialogue Systems Interspeech 2025 What is an “Abstract Reasoner”? Revisiting Experiments and Arguments about Large Language Models CoNLL 2025 Word-Level Error Analysis in Decoding Systems: From Speech Recognition to Brain-Computer Interfaces Interspeech 2025 X-ARES: A Comprehensive Framework for Assessing Audio Encoder Performance Interspeech 2025 ALI-Agent: Assessing LLMs' Alignment with Human Values via Agent-based Evaluation NeurIPS 2024 APDDv2: Aesthetics of Paintings and Drawings Dataset with Artist Labeled Scores and Comments NeurIPS 2024 BenchIE^FL: A Manually Re-Annotated Fact-Based Open Information Extraction Benchmark ACL 2024 Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory ICLR 2024 ContextRef: Evaluating Referenceless Metrics for Image Description Generation ICLR 2024 Davidsonian Scene Graph: Improving Reliability in Fine-grained Evaluation for Text-to-Image Generation ICLR 2024 HelloFresh: LLM Evalutions on Streams of Real-World Human Editorial Actions across X Community Notes and Wikipedia edits ACL 2024 Large Language Models as Automated Aligners for benchmarking Vision-Language Models ICLR 2024 Quantifying Local Model Validity using Active Learning UAI 2024 Social Reward: Evaluating and Enhancing Generative AI through Million-User Feedback from an Online Creative Community ICLR 2024 SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents ICLR 2024 The Trickle-down Impact of Reward Inconsistency on RLHF ICLR 2024 ToMBench: Benchmarking Theory of Mind in Large Language Models ACL 2024 UnlearnCanvas: Stylized Image Dataset for Enhanced Machine Unlearning Evaluation in Diffusion Models NeurIPS 2024 Unprocessing Seven Years of Algorithmic Fairness ICLR 2024 When is an Embedding Model More Promising than Another? NeurIPS 2024 Evaluating Long-Term Memory in 3D Mazes ICLR 2023 How Much Space Has Been Explored? Measuring the Chemical Space Covered by Databases and Machine-Generated Molecules ICLR 2023