prompt sensitivity

Promptception: How Sensitive Are Large Multimodal Models to Prompts? EMNLP 2025 ReliableEval: A Recipe for Stochastic LLM Evaluation via Method of Moments EMNLP 2025 SCORE: Systematic COnsistency and Robustness Evaluation for Large Language Models NAACL 2025 Speech-IFEval: Evaluating Instruction-Following and Quantifying Catastrophic Forgetting in Speech-Aware Language Models Interspeech 2025 Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model Evaluation ACL 2024 Challenging Large Language Models with New Tasks: A Study on their Adaptability and Robustness ACL 2024 Efficient multi-prompt evaluation of LLMs NeurIPS 2024 How are Prompts Different in Terms of Sensitivity? NAACL 2024 MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark NeurIPS 2024 On the Worst Prompt Performance of Large Language Models NeurIPS 2024 POSIX: A Prompt Sensitivity Index For Large Language Models EMNLP 2024 ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs EMNLP 2024 Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting ICLR 2024 Self-Assessment Tests are Unreliable Measures of LLM Personality EMNLP 2024 UniBias: Unveiling and Mitigating LLM Bias through Internal Attention and FFN Manipulation NeurIPS 2024 Reliability Check: An Analysis of GPT-3’s Response to Sensitive Topics and Prompt Wording ACL 2023 ToMChallenges: A Principle-Guided Dataset and Diverse Evaluation Tasks for Exploring Theory of Mind CoNLL 2023 Pre-training Language Models with Deterministic Factual Knowledge EMNLP 2022