Evaluation

Rethinking the Word-level Quality Estimation for Machine Translation from Human Judgement ACL 2023 Revisiting Automated Prompting: Are We Actually Doing Better? ACL 2023 Revisiting Bellman Errors for Offline Model Selection ICML 2023 Revisiting Commonsense Reasoning in Machine Translation: Training, Evaluation and Challenge ACL 2023 Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation ACL 2023 Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks EMNLP 2023 Rogue Scores ACL 2023 RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question ACL 2023 SAC3: Reliable Hallucination Detection in Black-Box Language Models via Semantic-aware Cross-check Consistency EMNLP 2023 SAM operates far from home: eigenvalue regularization as a dynamical phenomenon ICML 2023 Sampling-Based Accuracy Testing of Posterior Estimators for General Inference ICML 2023 Scalable and Explainable Automated Scoring for Open-Ended Constructed Response Math Word Problems ACL 2023 Scalable Membership Inference Attacks via Quantile Regression NeurIPS 2023 Scaling up CometKiwi: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task EMNLP 2023 Scientific Fact-Checking: A Survey of Resources and Approaches ACL 2023 Selection by Prediction with Conformal p-values JMLR 2023 Separating form and meaning: Using self-consistency to quantify task understanding across multiple senses EMNLP 2023 Shared Tasks as Tutorials: A Methodical Approach AAAI 2023 SLOG: A Structural Generalization Benchmark for Semantic Parsing EMNLP 2023 Statistical Comparisons of Classifiers by Generalized Stochastic Dominance JMLR 2023 Statistical Indistinguishability of Learning Algorithms ICML 2023 Statistical Knowledge Assessment for Large Language Models NeurIPS 2023 Statistically Profiling Biases in Natural Language Reasoning Datasets and Models EMNLP 2023 Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks EMNLP 2023 SuperTweetEval: A Challenging, Unified and Heterogeneous Benchmark for Social Media NLP Research EMNLP 2023