adversarial testing

A Checks-and-Balances Framework for Context-Aware Ethical AI Alignment ICML 2025 Agent vs. Agent: Automated Data Generation and Red-Teaming for Custom Agentic Workflows EMNLP 2025 Better Red Teaming via Searching with Large Language Model ACL 2025 Conflicting Needles in a Haystack: How LLMs behave when faced with contradictory information EMNLP 2025 DAMAGeR: Deploying Automatic and Manual Approaches to GenAI Red-teaming NAACL 2025 Dynamic Evaluation with Cognitive Reasoning for Multi-turn Safety of Large Language Models ACL 2025 M2S: Multi-turn to Single-turn jailbreak in Red Teaming for LLMs ACL 2025 Morables: A Benchmark for Assessing Abstract Moral Reasoning in LLMs with Fables EMNLP 2025 Refusal-Aware Red Teaming: Exposing Inconsistency in Safety Evaluations EMNLP 2025 REVEAL: Multi-turn Evaluation of Image-Input Harms for Vision LLMs IJCAI 2025 SAGE: A Generic Framework for LLM Safety Evaluation EMNLP 2025 Be a Multitude to Itself: A Prompt Evolution Framework for Red Teaming EMNLP 2024 Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models EACL 2024 GAATME: A Genetic Algorithm for Adversarial Translation Metrics Evaluation COLING 2024 StackEval: Benchmarking LLMs in Coding Assistance NeurIPS 2024 Whispers of Doubt Amidst Echoes of Triumph in NLP Robustness NAACL 2024 AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications EMNLP 2023 Adv3D: Generating Safety-Critical 3D Objects through Closed-Loop Simulation CoRL 2023 A Simple, Yet Effective Approach to Finding Biases in Code Generation ACL 2023 ASSERT: Automated Safety Scenario Red Teaming for Evaluating the Robustness of Large Language Models EMNLP 2023 Automatically Auditing Large Language Models via Discrete Optimization ICML 2023 Query-Efficient Black-Box Red Teaming via Bayesian Optimization ACL 2023 Which Spurious Correlations Impact Reasoning in NLI Models? A Visual Interactive Diagnosis through Data-Constrained Counterfactuals ACL 2023 DURINN: Adversarial Memory and Thread Interleaving for Detecting Durable Linearizability Bugs OSDI 2022 Measuring CLEVRness: Black-box Testing of Visual Reasoning Models ICLR 2022