Evaluation

Can Large Language Models Capture Dissenting Human Voices? EMNLP 2023 CCEval: A Representative Evaluation Benchmark for the Chinese-centric Multilingual Machine Translation EMNLP 2023 ChatGPT is fun, but it is not funny! Humor is still challenging Large Language Models ACL 2023 Class Adaptive Network Calibration CVPR 2023 COHESENTIA: A Novel Benchmark of Incremental versus Holistic Assessment of Coherence in Generated Texts EMNLP 2023 Common Law Annotations: Investigating the Stability of Dialog System Output Annotations ACL 2023 Comparative evaluation of boundary-relaxed annotation for Entity Linking performance ACL 2023 Comprehensive Algorithm Portfolio Evaluation using Item Response Theory JMLR 2023 Computational Asymmetries in Robust Classification ICML 2023 Conic10K: A Challenging Math Problem Understanding and Reasoning Dataset EMNLP 2023 Correction of Errors in Preference Ratings from Automated Metrics for Text Generation ACL 2023 Counterfactually Comparing Abstaining Classifiers NeurIPS 2023 Counterfactual reasoning: Testing language models’ understanding of hypothetical scenarios ACL 2023 C-PMI: Conditional Pointwise Mutual Information for Turn-level Dialogue Evaluation ACL 2023 CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion NeurIPS 2023 Curating Datasets for Better Performance with Example Training Dynamics ACL 2023 Curvature Filtrations for Graph Generative Model Evaluation NeurIPS 2023 C-XNLI: Croatian Extension of XNLI Dataset ACL 2023 Data Banzhaf: A Robust Data Valuation Framework for Machine Learning AISTATS 2023 Data Sampling and (In)stability in Machine Translation Evaluation ACL 2023 Debias NLU Datasets via Training-free Perturbations EMNLP 2023 Decoding Stumpers: Large Language Models vs. Human Problem-Solvers EMNLP 2023 Deconstructing Distributions: A Pointwise Framework of Learning ICLR 2023 DeltaScore: Fine-Grained Story Evaluation with Perturbations EMNLP 2023 Demystifying Disagreement-on-the-Line in High Dimensions ICML 2023