robustness evaluation

DiffHammer: Rethinking the Robustness of Diffusion-Based Adversarial Purification NeurIPS 2024 Distribution Shifts Are Bottlenecks: Extensive Evaluation for Grounding Language Models to Knowledge Bases EACL 2024 Do LLMs Overcome Shortcut Learning? An Evaluation of Shortcut Challenges in Large Language Models EMNLP 2024 Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Sets EMNLP 2024 Evaluating Robustness of Open Dialogue Summarization Models in the Presence of Naturally Occurring Variations ACL 2024 Foundation Model-oriented Robustness: Robust Image Model Evaluation with Pretrained Models ICLR 2024 FREB-TQA: A Fine-Grained Robustness Evaluation Benchmark for Table Question Answering NAACL 2024 GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solvers ACL 2024 ImageNet-D: Benchmarking Neural Network Robustness on Diffusion Synthetic Object CVPR 2024 IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localization NeurIPS 2024 JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models NeurIPS 2024 “Knowing When You Don’t Know”: A Multilingual Relevance Assessment Dataset for Robust Retrieval-Augmented Generation EMNLP 2024 Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarks EMNLP 2024 Navigating the Shadows: Unveiling Effective Disturbances for Modern AI Content Detectors ACL 2024 On the Robustness of Document-Level Relation Extraction Models to Entity Name Variations ACL 2024 On the Robustness of Editing Large Language Models EMNLP 2024 On the Robustness of Large Multimodal Models Against Image Adversarial Attacks CVPR 2024 OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios ACL 2024 PPTC-R benchmark: Towards Evaluating the Robustness of Large Language Models for PowerPoint Task Completion EMNLP 2024 PubDef: Defending Against Transfer Attacks From Public Models ICLR 2024 Resilience of Large Language Models for Noisy Instructions EMNLP 2024 RobustCLEVR: A Benchmark and Framework for Evaluating Robustness in Object-Centric Learning WACV 2024 RoTBench: A Multi-Level Benchmark for Evaluating the Robustness of Large Language Models in Tool Learning EMNLP 2024 Semi-Truths: A Large-Scale Dataset of AI-Augmented Images for Evaluating Robustness of AI-Generated Image detectors NeurIPS 2024 SETLEXSEM CHALLENGE: Using Set Operations to Evaluate the Lexical and Semantic Robustness of Language Models NeurIPS 2024