conftrace_

model reliability

46 papers

Explore in graph

Co-occurring keywords

large language model (13587) uncertainty quantification (1393) prompt sensitivity (40) out-of-distribution detection (617) text classification (6793) uncertainty estimation (648) confidence calibration (183) benchmark evaluation (1556) expected calibration error (46) fairness evaluation (118)

Papers

When LLMs Annotate: Reliability Challenges in Low-Resource NLI EACL 2026
ReMedQA: Are We Done With Medical Multiple-Choice Benchmarks? EACL 2026
Implications for AI Research: Applying Lessons from the Expert Systems Boom and Bust to the Current Large-Language Model Boom AAAI 2026
GlitchMiner: Mining Glitch Tokens in Large Language Models via Gradient-based Discrete Optimization AAAI 2026
Small Models Exhibit Limited Answer Consistency in Repetition Trials of the Multiple-Choice MMLU-Redux and MedQA Benchmarks AAAI 2026
Unveiling Uncertainty: A Deep Dive into Calibration and Performance of Multimodal Large Language Models COLING 2025
Conflicts in Texts: Data, Implications and Challenges EMNLP 2025
Can Multiple Responses from an LLM Reveal the Sources of Its Uncertainty? EMNLP 2025
The Lawyer That Never Thinks: Consistency and Fairness as Keys to Reliable AI ACL 2025
Calibrating LLM Confidence by Probing Perturbed Representation Stability EMNLP 2025
SUE: Sparsity-based Uncertainty Estimation via Sparse Dictionary Learning EMNLP 2025
Echoes of Agreement: Argument Driven Sycophancy in Large Language models EMNLP 2025
Steering off Course: Reliability Challenges in Steering Language Models ACL 2025
Do LLMs Know When to NOT Answer? Investigating Abstention Abilities of Large Language Models COLING 2025
Evaluating Calibration of Arabic Pre-trained Language Models on Dialectal Text COLING 2025
RedHerring Attack: Testing the Reliability of Attack Detection EMNLP 2025
The Mainstays of Trustworthy Machine Learning AAAI 2025
Activation Subspaces for Out-of-Distribution Detection ICCV 2025
Trust Me, I’m Wrong: LLMs Hallucinate with Certainty Despite Knowing the Answer EMNLP 2025
Evaluating Uncertainty Quantification Methods in Argumentative Large Language Models EMNLP 2025
Assessing Reliability and Political Bias In LLMs’ Judgements of Formal and Material Inferences With Partisan Conclusions ACL 2025
Rationales Are Not Silver Bullets: Measuring the Impact of Rationales on Model Performance and Reliability ACL 2025
Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Ambiguous Prompts and Unanswerable Questions EMNLP 2025
On the Worst Prompt Performance of Large Language Models NIPS 2024
On the Reliability of Psychological Scales on Large Language Models EMNLP 2024