Evaluation

TokCollate: A Comprehensive Tool for Tokenizer Evaluation and Visualization across Languages ACL 2026 TokLens: A Multilingual Lens on Tokenizer Quality for LLMs ACL 2026 Toward Robust Evaluation for Multilingual Grammatical Error Correction: Can Large Language Models Replace Human References? ACL 2026 Translation or Recitation? Calibrating Evaluation Scores for Machine Translation of Extremely Low-Resource Languages ACL 2026 uircis at SemEval-2026 Task 8: A Unified Lightweight Pipeline for Multi-Turn RAG Evaluation SemEval 2026 When High Accuracy Hides Poor Calibration: Rethinking Confidence Evaluation in Transformer-Based Text Classification with Balanced Brier Score ACL 2026 A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better Interpretability ACL 2025 Comparison-Based Automatic Evaluation for Meeting Summarization Interspeech 2025 Crowdsourcing MUSHRA Tests in the Age of Generative Speech Technologies: A Comparative Analysis of Subjective and Objective Testing Methods Interspeech 2025 DLU: Dictionary Look-Up Data and Prediction CoNLL 2025 Open Universal Arabic ASR Leaderboard Interspeech 2025 RELATE: Subjective evaluation dataset for automatic evaluation of relevance between text and audio Interspeech 2025 SOVA-Bench: Benchmarking the Speech Conversation Ability for LLM-based Voice Assistant Interspeech 2025 Team ACK at SemEval-2025 Task 2: Beyond Word-for-Word Machine Translation for English-Korean Pairs SemEval 2025 ImagenHub: Standardizing the evaluation of conditional image generation models ICLR 2024 SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words NeurIPS 2024 STREAM: Spatio-TempoRal Evaluation and Analysis Metric for Video Generative Models ICLR 2024 Topic-Conversation Relevance (TCR) Dataset and Benchmarks NeurIPS 2024 Vertical Validation: Evaluating Implicit Generative Models for Graphs on Thin Support Regions UAI 2024 A framework for benchmarking Class-out-of-distribution detection and its application to ImageNet ICLR 2023 FactSpotter: Evaluating the Factual Faithfulness of Graph-to-Text Generation EMNLP 2023 HAUSER: Towards Holistic and Automatic Evaluation of Simile Generation ACL 2023 SMART: Sentences as Basic Units for Text Evaluation ICLR 2023 Measuring Massive Multitask Language Understanding ICLR 2021 BERTScore: Evaluating Text Generation with BERT ICLR 2020