conftrace_

adversarial testing

31 papers

Explore in graph

Co-occurring keywords

large language model (13587) safety evaluation (94) red teaming (61) prompt engineering (1135) natural language inference (1287) adversarial robustness (1341) reinforcement learning (4352) ai safety evaluation (2) harm detection (8) neural model (240)

Papers

Refusal-Aware Red Teaming: Exposing Inconsistency in Safety Evaluations EMNLP 2025
Morables: A Benchmark for Assessing Abstract Moral Reasoning in LLMs with Fables EMNLP 2025
Conflicting Needles in a Haystack: How LLMs behave when faced with contradictory information EMNLP 2025
SAGE: A Generic Framework for LLM Safety Evaluation EMNLP 2025
Agent vs. Agent: Automated Data Generation and Red-Teaming for Custom Agentic Workflows EMNLP 2025
DAMAGeR: Deploying Automatic and Manual Approaches to GenAI Red-teaming NAACL 2025
REVEAL: Multi-turn Evaluation of Image-Input Harms for Vision LLMs IJCAI 2025
Better Red Teaming via Searching with Large Language Model ACL 2025
M2S: Multi-turn to Single-turn jailbreak in Red Teaming for LLMs ACL 2025
Dynamic Evaluation with Cognitive Reasoning for Multi-turn Safety of Large Language Models ACL 2025
Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models EACL 2024
GAATME: A Genetic Algorithm for Adversarial Translation Metrics Evaluation COLING 2024
StackEval: Benchmarking LLMs in Coding Assistance NIPS 2024
Be a Multitude to Itself: A Prompt Evolution Framework for Red Teaming EMNLP 2024
Whispers of Doubt Amidst Echoes of Triumph in NLP Robustness NAACL 2024
Query-Efficient Black-Box Red Teaming via Bayesian Optimization ACL 2023
Adv3D: Generating Safety-Critical 3D Objects through Closed-Loop Simulation CORL 2023
ASSERT: Automated Safety Scenario Red Teaming for Evaluating the Robustness of Large Language Models EMNLP 2023
Automatically Auditing Large Language Models via Discrete Optimization ICML 2023
Which Spurious Correlations Impact Reasoning in NLI Models? A Visual Interactive Diagnosis through Data-Constrained Counterfactuals ACL 2023
AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications EMNLP 2023
A Simple, Yet Effective Approach to Finding Biases in Code Generation ACL 2023
Towards Explainable Evaluation of Language Models on the Semantic Similarity of Visual Concepts COLING 2022
Simulated Adversarial Testing of Face Recognition Models CVPR 2022
DURINN: Adversarial Memory and Thread Interleaving for Detecting Durable Linearizability Bugs OSDI 2022