benchmark evaluation

RDumb: A simple approach that questions our progress in continual test-time adaptation NeurIPS 2023 READIN: A Chinese Multi-Task Benchmark with Realistic and Diverse Input Noises ACL 2023 REASONER: An Explainable Recommendation Dataset with Comprehensive Labeling Ground Truths NeurIPS 2023 Rethink DARTS Search Space and Renovate a New Benchmark ICML 2023 Revealing Weaknesses of Vietnamese Language Models Through Unanswerable Questions in Machine Reading Comprehension EACL 2023 Revisiting Cross-Lingual Summarization: A Corpus-based Study and A New Benchmark with Improved Annotation ACL 2023 Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evaluations NeurIPS 2023 Revisiting Scene Text Recognition: A Data Perspective ICCV 2023 RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptions NeurIPS 2023 RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbations ACL 2023 Rogue Scores ACL 2023 Sample-Efficient Reinforcement Learning by Breaking the Replay Ratio Barrier ICLR 2023 SciRepEval: A Multi-Format Benchmark for Scientific Document Representations EMNLP 2023 ScoNe: Benchmarking Negation Reasoning in Language Models With Fine-Tuning and In-Context Learning ACL 2023 Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Images NeurIPS 2023 Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together! ICLR 2023 Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks EMNLP 2023 StoryBench: A Multifaceted Benchmark for Continuous Story Visualization NeurIPS 2023 SugarCrepe: Fixing Hackable Benchmarks for Vision-Language Compositionality NeurIPS 2023 SuperTweetEval: A Challenging, Unified and Heterogeneous Benchmark for Social Media NLP Research EMNLP 2023 Svarah: Evaluating English ASR Systems on Indian Accents Interspeech 2023 Task Ambiguity in Humans and Language Models ICLR 2023 The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation ACL 2023 The OPUS-MT Dashboard – A Toolkit for a Systematic Evaluation of Open Machine Translation Models ACL 2023 Theory of Mind in Large Language Models: Examining Performance of 11 State-of-the-Art models vs. Children Aged 7-10 on Advanced Tests CoNLL 2023