model evaluation

442 papers

Explore in graph

Co-occurring keywords

large language model (12755) benchmark evaluation (1539) text classification (6776) language model (4573) natural language processing (2027) evaluation benchmark (250) natural language inference (1278) multimodal learning (4622) bias detection (419) transfer learning (5442)

Papers

Explaining CLIP's Performance Disparities on Data from Blind/Low Vision Users CVPR 2024

HEMM: Holistic Evaluation of Multimodal Foundation Models NIPS 2024

I2EBench: A Comprehensive Benchmark for Instruction-based Image Editing NIPS 2024

Questioning the Survey Responses of Large Language Models NIPS 2024

BIGOS V2 Benchmark for Polish ASR: Curated Datasets and Tools for Reproducible Evaluation NIPS 2024

LLMEval: A Preliminary Study on How to Evaluate Large Language Models AAAI 2024

Divide-and-Aggregate Learning for Evaluating Performance on Unlabeled Data AAAI 2024

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models ACL 2024

OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety ACL 2024

Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinement ACL 2024

Benchmarking Cognitive Biases in Large Language Models as Evaluators ACL 2024

SedarEval: Automated Evaluation using Self-Adaptive Rubrics EMNLP 2024

SEFLAG: Systematic Evaluation Framework for NLP Models and Datasets in Latin and Ancient Greek EMNLP 2024

CAVA: A Tool for Cultural Alignment Visualization & Analysis EMNLP 2024

Don’t be my Doctor! Recognizing Healthcare Advice in Large Language Models EMNLP 2024

Systematic Evaluation of Long-Context LLMs on Financial Concepts EMNLP 2024

Rethinking Evaluation Methods for Machine Unlearning EMNLP 2024

Plot Twist: Multimodal Models Don’t Comprehend Simple Chart Details EMNLP 2024

The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models EMNLP 2024

Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation EMNLP 2024

Comparing Template-based and Template-free Language Model Probing EACL 2024

Generation, Distillation and Evaluation of Motivational Interviewing-Style Reflections with a Foundational Language Model EACL 2024

Benchmark Transparency: Measuring the Impact of Data on Evaluation NAACL 2024

Weak Supervision Performance Evaluation via Partial Identification NIPS 2024

CodeIPPrompt: Intellectual Property Infringement Assessment of Code Language Models ICML 2023