model evaluation

FACET: Fairness in Computer Vision Evaluation Benchmark ICCV 2023 “Fifty Shades of Bias”: Normative Ratings of Gender Bias in GPT Generated English Text EMNLP 2023 FinGPT: Large Generative Models for a Small Language EMNLP 2023 GNNEvaluator: Evaluating GNN Performance On Unseen Graphs Without Labels NeurIPS 2023 How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources NeurIPS 2023 How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench EMNLP 2023 How Well Do Text Embedding Models Understand Syntax? EMNLP 2023 Investigating model performance in language identification: beyond simple error statistics Interspeech 2023 Is the Performance of My Deep Network Too Good to Be True? A Direct Approach to Estimating the Bayes Error in Binary Classification ICLR 2023 Knowledge-based in silico models and dataset for the comparative evaluation of mammography AI for a range of breast characteristics, lesion conspicuities and doses NeurIPS 2023 Legal Judgment Prediction: If You Are Going to Do It, Do It Right EMNLP 2023 Lexical Repetitions Lead to Rote Learning: Unveiling the Impact of Lexical Overlap in Train and Test Reference Summaries EMNLP 2023 LLMs – the Good, the Bad or the Indispensable?: A Use Case on Legal Statute Prediction and Legal Judgment Prediction on Indian Court Cases EMNLP 2023 LMentry: A Language Model Benchmark of Elementary Language Tasks ACL 2023 Measuring Consistency in Text-based Financial Forecasting Models ACL 2023 MM-SHAP: A Performance-agnostic Metric for Measuring Multimodal Contributions in Vision and Language Models & Tasks ACL 2023 Model Analysis & Evaluation for Ambiguous Question Answering ACL 2023 NatLogAttack: A Framework for Attacking Natural Language Inference Models with Natural Logic ACL 2023 NewsRecLib: A PyTorch-Lightning Library for Neural News Recommendation EMNLP 2023 OLEA: Tool and Infrastructure for Offensive Language Error Analysis in English EACL 2023 On General Language Understanding EMNLP 2023 On the Calibration of Large Language Models and Alignment EMNLP 2023 RealBehavior: A Framework for Faithfully Characterizing Foundation Models’ Human-like Behavior Mechanisms EMNLP 2023 Revisiting Instruction Fine-tuned Model Evaluation to Guide Industrial Applications EMNLP 2023 Rogue Scores ACL 2023