adversarial dataset

NaturalSloth: Revisiting Denial-of-Service Attacks on Large Language Models ACL 2026 Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness NAACL 2025 Language Models May Verbatim Complete Text They Were Not Explicitly Trained On ICML 2025 Science-T2I: Addressing Scientific Illusions in Image Synthesis CVPR 2025 Beyond the Surface: Spurious Cues in Automatic Media Bias Detection EACL 2024 Do We Need Language-Specific Fact-Checking Models? The Case of Chinese EMNLP 2024 FOOL ME IF YOU CAN! An Adversarial Dataset to Investigate the Robustness of LMs in Word Sense Disambiguation EMNLP 2024 GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solvers ACL 2024 Mothman at SemEval-2024 Task 9: An Iterative System for Chain-of-Thought Prompt Optimization SemEval 2024 Adversarially Constructed Evaluation Sets Are More Challenging, but May Not Be Fair NAACL 2022 Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-Based Hate NAACL 2022 An Evaluation Dataset and Strategy for Building Robust Multi-turn Response Selection Model EMNLP 2021 Assessing the Generalization Capacity of Pre-trained Language Models through Japanese Adversarial Natural Language Inference EMNLP 2021 Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics EMNLP 2021 What Will it Take to Fix Benchmarking in Natural Language Understanding? NAACL 2021 Adversarial NLI: A New Benchmark for Natural Language Understanding ACL 2020 What’s in a Name? Are BERT Named Entity Representations just as Good for any other Name? ACL 2020 WinoGrande: An Adversarial Winograd Schema Challenge at Scale AAAI 2020 CODAH: An Adversarially-Authored Question Answering Dataset for Common Sense NAACL 2019 Diversify Your Datasets: Analyzing Generalization via Controlled Variance in Adversarial Datasets CoNLL 2019 DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs NAACL 2019 PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identification EMNLP 2019 Probing Neural Network Comprehension of Natural Language Arguments ACL 2019