conftrace_

prompt sensitivity

40 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) prompt engineering (1135) model reliability (46) model evaluation (445) in-context learning (1405) prompt variation (10) evaluation benchmark (257) model robustness (480) human evaluation (379)

Papers

Large Language Models Badly Generalize across Option Length, Problem Types, and Irrelevant Noun Replacements EMNLP 2025
More Than a Score: Probing the Impact of Prompt Specificity on LLM Code Generation AACL 2025
UniBias: Unveiling and Mitigating LLM Bias through Internal Attention and FFN Manipulation NIPS 2024
MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark NIPS 2024
Self-Assessment Tests are Unreliable Measures of LLM Personality EMNLP 2024
Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model Evaluation ACL 2024
Efficient multi-prompt evaluation of LLMs NIPS 2024
ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs EMNLP 2024
POSIX: A Prompt Sensitivity Index For Large Language Models EMNLP 2024
On the Worst Prompt Performance of Large Language Models NIPS 2024
Challenging Large Language Models with New Tasks: A Study on their Adaptability and Robustness ACL 2024
How are Prompts Different in Terms of Sensitivity? NAACL 2024
Reliability Check: An Analysis of GPT-3’s Response to Sensitive Topics and Prompt Wording ACL 2023
ToMChallenges: A Principle-Guided Dataset and Diverse Evaluation Tasks for Exploring Theory of Mind CONLL 2023
Pre-training Language Models with Deterministic Factual Knowledge EMNLP 2022