conftrace_

model reliability

46 papers

Explore in graph

Co-occurring keywords

large language model (13587) uncertainty quantification (1393) prompt sensitivity (40) out-of-distribution detection (617) text classification (6793) uncertainty estimation (648) confidence calibration (183) benchmark evaluation (1556) expected calibration error (46) fairness evaluation (118)

Papers

To Err Is Human, How about Medical Large Language Models? Comparing Pre-trained Language Models for Medical Assessment Errors and Reliability COLING 2024
You don’t need a personality test to know these models are unreliable: Assessing the Reliability of Large Language Models on Psychometric Instruments NAACL 2024
BERT-IRT: Accelerating Item Piloting with BERT Embeddings and Explainable IRT Models NAACL 2024
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models ACL 2024
Please note that I’m just an AI: Analysis of Behavior Patterns of LLMs in (Non-)offensive Speech Identification EMNLP 2024
Two Sides of Miscalibration: Identifying Over and Under-Confidence Prediction for Network Calibration UAI 2023
Reliability Check: An Analysis of GPT-3’s Response to Sensitive Topics and Prompt Wording ACL 2023
RainProof: An Umbrella to Shield Text Generator from Out-Of-Distribution Data EMNLP 2023
Great Models Think Alike: Improving Model Reliability via Inter-Model Latent Agreement ICML 2023
GAIA: Delving into Gradient-based Attribution Abnormality for Out-of-distribution Detection NIPS 2023
Robust and Adaptive Deep Learning via Bayesian Principles AAAI 2023
On the Calibration of Large Language Models and Alignment EMNLP 2023
Reliability in Semantic Segmentation: Are We on the Right Track? CVPR 2023
Post-Abstention: Towards Reliably Re-Attempting the Abstained Instances in QA ACL 2023
MLDemon:Deployment Monitoring for Machine Learning Systems AISTATS 2022
Mitigating Bias in Calibration Error Estimation AISTATS 2022
Safety Analysis of Deep Neural Networks IJCAI 2021
Evaluating the Robustness of Neural Language Models to Input Perturbations EMNLP 2021
JCT at SemEval-2020 Task 1: Combined Semantic Vector Spaces Models for Unsupervised Lexical Semantic Change Detection SEMEVAL 2020
Can You Trust This Prediction? Auditing Pointwise Reliability After Learning AISTATS 2019
Predicting When Saliency Maps Are Accurate and Eye Fixations Consistent CVPR 2016