Evaluation

Tools Fail: Detecting Silent Errors in Faulty Tools EMNLP 2024 Toward Conditional Distribution Calibration in Survival Prediction NeurIPS 2024 Towards a new Benchmark for Emotion Detection in NLP: A Unifying Framework of Recent Corpora EMNLP 2024 Towards a Perceptual Evaluation Framework for Lighting Estimation CVPR 2024 Towards Human-AI Complementarity with Prediction Sets NeurIPS 2024 Towards More Robust NLP System Evaluation: Handling Missing Scores in Benchmarks EMNLP 2024 Towards Multiple References Era – Addressing Data Leakage and Limited Reference Diversity in Machine Translation Evaluation ACL 2024 Towards Objectively Benchmarking Social Intelligence of Language Agents at the Action Level ACL 2024 Towards Robust Evaluation of Unlearning in LLMs via Data Transformations EMNLP 2024 ToxiCloakCN: Evaluating Robustness of Offensive Language Detection in Chinese with Cloaking Perturbations EMNLP 2024 TRAM: Benchmarking Temporal Reasoning for Large Language Models ACL 2024 Transferability Bound Theory: Exploring Relationship between Adversarial Transferability and Flatness NeurIPS 2024 Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps EMNLP 2024 UHGEval: Benchmarking the Hallucination of Chinese Large Language Models via Unconstrained Generation ACL 2024 UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs ACL 2024 UMA: Facilitating Backdoor Scanning via Unlearning-Based Model Ablation AAAI 2024 Uncertainty in Language Models: Assessment through Rank-Calibration EMNLP 2024 Uncertainty Quantification for Data-Driven Change-Point Learning via Cross-Validation AAAI 2024 Understanding and Mitigating Language Confusion in LLMs EMNLP 2024 Understanding Generalization of Federated Learning via Stability: Heterogeneity Matters AISTATS 2024 Understanding the Effects of Noise in Text-to-SQL: An Examination of the BIRD-Bench Benchmark ACL 2024 Unexpected Phenomenon: LLMs’ Spurious Associations in Information Extraction ACL 2024 Unified Hallucination Detection for Multimodal Large Language Models ACL 2024 Unveiling Selection Biases: Exploring Order and Token Sensitivity in Large Language Models ACL 2024 Unveiling the Tapestry of Automated Essay Scoring: A Comprehensive Investigation of Accuracy, Fairness, and Generalizability AAAI 2024