conftrace_

failure detection

26 papers

Explore in graph

Co-occurring keywords

large language model (13587) model evaluation (445) model reliability (46) confidence estimation (167) scenario generation (24) system evaluation (33) systematic failure (4) out-of-distribution detection (617) human-robot interaction (218) confidence calibration (183)

Papers

NeuReasoner: Towards Explainable, Controllable, and Unified Reasoning via Mixture-of-Neurons ACL 2026
RoboFailRing: Retrieval-Augmented and Language Grounding Failure Detection for VLM-enabled Robotic Manipulation ACL 2026
Adaptively profiling models with task elicitation EMNLP 2025
Breaking Agents: Compromising Autonomous LLM Agents Through Malfunction Amplification EMNLP 2025
Interpretable Failure Detection with Human-Level Concepts AAAI 2025
A Proactive Reliability Metric for Detecting Failures in Language Model Training EMNLP 2025
Self-Correcting Robot Manipulation via Gaussian-Splatted Foresight AAAI 2025
Can We Detect Failures Without Failure Data? Uncertainty-Aware Runtime Failure Detection for Imitation Learning Policies RSS 2025
Evaluating Compound AI Systems through Behaviors, Not Benchmarks EMNLP 2025
Code-as-Monitor: Constraint-aware Visual Programming for Reactive and Proactive Robotic Failure Detection CVPR 2025
Typicalness-Aware Learning for Failure Detection NIPS 2024
RCL: Reliable Continual Learning for Unified Failure Detection CVPR 2024
SynthEval: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists EMNLP 2024
Mass-Producing Failures of Multimodal Systems with Language Models NIPS 2023
Great Models Think Alike: Improving Model Reliability via Inter-Model Latent Agreement ICML 2023
Model-based Validation as Probabilistic Inference L4DC 2023
Two Sides of Miscalibration: Identifying Over and Under-Confidence Prediction for Network Calibration UAI 2023
Surrogate Assisted Generation of Human-Robot Interaction Scenarios CORL 2023
Detecting Ephemeral Optical Events with OpTel NSDI 2022
Task-Relevant Failure Detection for Trajectory Predictors in Autonomous Vehicles CORL 2022
A Quality Diversity Approach to Automatically Generating Human-Robot Interaction Scenarios in Shared Autonomy RSS 2021
Perception Matters: Detecting Perception Failures of VQA Models Using Metamorphic Testing CVPR 2021
TestRank: Bringing Order into Unlabeled Test Instances for Deep Learning Tasks NIPS 2021
Testing Configuration Changes in Context to Prevent Production Failures OSDI 2020
Capturing and Enhancing In Situ System Observability for Failure Detection OSDI 2018