conftrace_

behavioral testing

17 papers

Explore in graph

Co-occurring keywords

large language model (13587) model evaluation (445) nlp model (43) translation quality (224) test case generation (24) linguistic capability (8) language model (4599) question answering (2963) machine translation (2499) natural language processing (2034)

Papers

DeVisE: Towards the Behavioral Testing of Medical Large Language Models EACL 2026
Are LLM-based Evaluators Confusing NLG Quality Criteria? ACL 2024
Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMs NIPS 2024
Whispers of Doubt Amidst Echoes of Triumph in NLP Robustness NAACL 2024
SynthEval: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists EMNLP 2024
Automating Behavioral Testing in Machine Translation EMNLP 2023
A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models ACL 2023
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features ACL 2023
Towards General Error Diagnosis via Behavioral Testing in Machine Translation EMNLP 2023
UKP-SQUARE: An Online Platform for Question Answering Research ACL 2022
Checking HateCheck: a cross-functional analysis of behaviour-aware learning for hate speech detection ACL 2022
What Do You See in this Patient? Behavioral Testing of Clinical NLP Models NAACL 2022
SALTED: A Framework for SAlient Long-tail Translation Error Detection EMNLP 2022
A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist EACL 2021
Beyond Accuracy: Behavioral Testing of NLP Models with Checklist (Extended Abstract) IJCAI 2021
Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates ACL 2021
Beyond Accuracy: Behavioral Testing of NLP Models with CheckList ACL 2020